-- Logs begin at Mon 2022-08-01 14:36:17 UTC, end at Mon 2022-08-01 16:14:09 UTC. -- Aug 01 15:34:43.650433 dv-cinder-847132-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 15:34:43.659926 dv-cinder-847132-3-smb devstack@keystone.service[92548]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:34:43 2022] *** Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: nodename: dv-cinder-847132-3-smb Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: machine: x86_64 Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: clock source: unix Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: pcre jit disabled Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: detected number of CPU cores: 4 Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: current working directory: / Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: your processes number limit is 47680 Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: your memory page size is 4096 bytes Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: detected max file descriptor number: 2048 Aug 01 15:34:43.661971 dv-cinder-847132-3-smb devstack@keystone.service[92548]: lock engine: pthread robust mutexes Aug 01 15:34:43.662709 dv-cinder-847132-3-smb devstack@keystone.service[92548]: thunder lock: enabled Aug 01 15:34:43.662709 dv-cinder-847132-3-smb devstack@keystone.service[92548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 15:34:43.662709 dv-cinder-847132-3-smb devstack@keystone.service[92548]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:34:43.703380 dv-cinder-847132-3-smb devstack@keystone.service[92548]: Python main interpreter initialized at 0x55653be529c0 Aug 01 15:34:43.703380 dv-cinder-847132-3-smb devstack@keystone.service[92548]: python threads support enabled Aug 01 15:34:43.703380 dv-cinder-847132-3-smb devstack@keystone.service[92548]: your server socket listen backlog is limited to 100 connections Aug 01 15:34:43.703380 dv-cinder-847132-3-smb devstack@keystone.service[92548]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:34:43.711908 dv-cinder-847132-3-smb devstack@keystone.service[92548]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:34:43.711908 dv-cinder-847132-3-smb devstack@keystone.service[92548]: *** Operational MODE: preforking *** Aug 01 15:34:43.711908 dv-cinder-847132-3-smb devstack@keystone.service[92548]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:34:43.711908 dv-cinder-847132-3-smb devstack@keystone.service[92548]: spawned uWSGI master process (pid: 92548) Aug 01 15:34:43.711908 dv-cinder-847132-3-smb devstack@keystone.service[92548]: spawned uWSGI worker 1 (pid: 92564, cores: 1) Aug 01 15:34:43.711908 dv-cinder-847132-3-smb devstack@keystone.service[92548]: spawned uWSGI worker 2 (pid: 92565, cores: 1) Aug 01 15:34:43.711908 dv-cinder-847132-3-smb devstack@keystone.service[92548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:34:43.704288 dv-cinder-847132-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 01 15:34:49.266305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:34:49.266305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: from cryptography.utils import int_from_bytes Aug 01 15:34:49.267113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:34:49.267113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: from cryptography.utils import int_from_bytes Aug 01 15:34:49.267231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:34:49.267231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: from cryptography.utils import int_from_bytes Aug 01 15:34:49.267231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:34:49.267231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: from cryptography.utils import int_from_bytes Aug 01 15:34:49.317567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:34:49.317753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:34:49.317948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] command line args: [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:34:49.318129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:34:49.318218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:34:49.318340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:34:49.318472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ================================================================================ {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:34:49.318560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] command line args: [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:34:49.318640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] admin_token = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.318795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:34:49.318878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] config_dir = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.318975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ================================================================================ {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:34:49.319064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] config_source = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] admin_token = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] debug = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] config_dir = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] config_source = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.319950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] debug = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.320922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] list_limit = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] log_config_append = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] list_limit = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] log_dir = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] log_config_append = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321573 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] log_file = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.321879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] log_dir = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] log_file = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322573 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.322946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.323870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.324078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.324687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.324765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.324838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.324996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.325110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.325234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.325333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.325486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.325597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.325765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] publish_errors = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] publish_errors = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.326964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] standard_threads = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.327867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] standard_threads = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] use_journal = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] use_json = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] use_stderr = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] use_journal = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.328934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] use_syslog = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.329030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] use_json = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.329107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.329252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] use_stderr = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.329351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.329428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] use_syslog = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.329614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:34:49.329705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.329875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.329963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.330930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.331892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.332865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.333870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.334996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.335947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.336963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.337933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.338913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.339986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.340959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341573 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.341936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.342972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.343896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.344999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.345978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.346953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.347989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.348936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349168 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.349906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.350862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351799 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.351951 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.352965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.353954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] auth.external = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] auth.external = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.354921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.355080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.355188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.355366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] auth.password = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.355495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.355632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] auth.token = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.355758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.355885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] auth.password = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] auth.token = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.356931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] credential.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.357823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] credential.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.358973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359732 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.359981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.360114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.360237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.360362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.360493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.360624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.360756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.360966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.361093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.361223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.361348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.361473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.361648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.361787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.361913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.362952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.363974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.364106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.364232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.364357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.364483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.364609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.364741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.364912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.365938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.366943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.367861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.368863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.369981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.370058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.370220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.370300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.370463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.370543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.370692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.370769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.371460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.371541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.371712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.371790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.371951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.372920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.373968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.374930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.375866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.376975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.377959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.378994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379225 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.379932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.380965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.381201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.381278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.381449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.381598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.381709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.381788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.381948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.382995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.383950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.384893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.385872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.386021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.386100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.386265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.386343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.386555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.387187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.387328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.387406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.387570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.387648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.387810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.387895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] role.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.388856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] role.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] role.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] role.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.389838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.390993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.391956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.392965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.393119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.393363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.393442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.393628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.393710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.393879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.393959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.394941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.395894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.396856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.397993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.398949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.399989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.400943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.401919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.connection = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.connection = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.402976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.403913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.404866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.405849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.406012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.406090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.406244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.406321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.406398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:34:49.406470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.406713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:34:49.406884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:34:49.436934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.437164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.437271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.437399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.437563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.437640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.446038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.446182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.476737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.476933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.477023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.477100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.531364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.531530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.583520 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.583720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.583795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.583899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.650566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.650797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651471 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.651942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.652257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.675669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.675827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.675896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.676901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.677047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.677187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.689213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.689331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.702177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.702406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.702491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.702637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.702723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.702864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.702947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.703087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.703179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.703304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.703387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.703559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.703651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.703725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:34:49.720578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.720786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:34:49.721113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.721201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.721317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:34:49.721418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:34:49.721616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.721701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.721883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:34:49.721964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.722146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.722241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.722408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.722499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.722662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.722916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.732705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.732986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.733166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.733250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.733450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.733554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.733752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.734039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.740474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.740949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.745294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.745619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.745852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.746451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.746626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.746737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.746912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.747022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.747196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.747277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.747481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.747560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.747756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.747844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.748015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.748095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.748287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.748377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.748556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.748637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.748832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.749100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.771541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.772057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.773040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.773327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.773587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.773873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.777985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.778265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.778530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.778613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.778811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.779092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.785206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.785444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.785689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.785979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.789571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.789866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.790115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.790198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.790406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.790487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.790706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.790790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.790988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.791068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.791258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.791348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.791537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.791618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.791817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.792106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.807899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.808182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.809068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.809349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.812945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.813591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.816091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.816393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.816714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.817013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.820799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.821501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.824066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.824733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.827251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.827552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.827852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.827935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.828153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.828235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.828444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.828536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.828734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.828817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.829015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.829308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.844817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.845105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.845314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.845405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.845638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.845728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.845913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.846181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.852530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.853179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.854093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.854376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.854745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.855025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.857869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.858157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.858396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.858480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.858683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.858766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.858988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.859071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.859274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.859566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.870474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.871358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.871532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.871659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.871816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.871934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.872098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.872214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.872377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.872492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.872654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.872770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.872925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.873198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.888366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.888776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.891353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.891791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.894322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.894784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.896944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.897422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.898536 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.898828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.899047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.899130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.899342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.899623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.905602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.906125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.907205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.907731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.910145 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.919808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.919953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.920384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.920560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.920871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.921366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.926988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.927270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.927553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.927831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.928110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.928393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.928667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.928956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.929334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.929659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.929947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.930217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.930494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.930775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.934175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:34:49.934469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.934757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.935037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.935573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.935855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.936140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.936409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.936789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.937071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.937354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.937646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.937933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.938216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:34:49.965370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55653be529c0 pid: 92565 (default app) Aug 01 15:34:49.968856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39221d6d-0725-4ab3-996d-e7a67e5f03b8 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:34:49.969151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39221d6d-0725-4ab3-996d-e7a67e5f03b8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:34:49.969434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39221d6d-0725-4ab3-996d-e7a67e5f03b8 None None] PATH_INFO: `/v3` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:34:49.972455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55653be529c0 pid: 92564 (default app) Aug 01 15:34:49.973804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Mon Aug 1 15:34:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:34:58.891066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18906a7-39fa-4dd0-9996-a37d60415240 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:34:58.891635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18906a7-39fa-4dd0-9996-a37d60415240 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:34:58.891635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18906a7-39fa-4dd0-9996-a37d60415240 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:34:58.896079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:34:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:34:58.902122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:34:58.902559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:34:58.902685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:34:58.974546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: INFO dbcounter [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] Registered counter for database keystone Aug 01 15:34:58.997215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG oslo_db.sqlalchemy.engines [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:34:59.003913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writer thread running {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:34:59.185453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG passlib.handlers.bcrypt [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92565) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 15:34:59.185813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG passlib.handlers.bcrypt [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92565) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 15:34:59.241297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:34:59.242975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:34:59.380364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:34:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 15:34:59.547075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18906a7-39fa-4dd0-9996-a37d60415240 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:34:59.617029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: INFO dbcounter [None req-f18906a7-39fa-4dd0-9996-a37d60415240 None None] Registered counter for database keystone Aug 01 15:34:59.637100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG oslo_db.sqlalchemy.engines [None req-f18906a7-39fa-4dd0-9996-a37d60415240 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:34:59.643411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writer thread running {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:34:59.763915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18906a7-39fa-4dd0-9996-a37d60415240 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:34:59.768499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84643c4c-6197-4e28-a211-45dee20a3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:34:59.769138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643c4c-6197-4e28-a211-45dee20a3ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:34:59.769422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643c4c-6197-4e28-a211-45dee20a3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:34:59.769727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643c4c-6197-4e28-a211-45dee20a3ef6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:34:59.779069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84643c4c-6197-4e28-a211-45dee20a3ef6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:34:59.831814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84643c4c-6197-4e28-a211-45dee20a3ef6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 15:34:59.832075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84643c4c-6197-4e28-a211-45dee20a3ef6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:34:59.843254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Mon Aug 1 15:34:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:34:59.849274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:34:59.865935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a49a7-e60d-42ad-9ca3-0823f5a6cadc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:34:59.871062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cc244-cd55-44ec-84fb-9be6a53718f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:34:59.872264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cc244-cd55-44ec-84fb-9be6a53718f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:34:59.872597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cc244-cd55-44ec-84fb-9be6a53718f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:34:59.872948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cc244-cd55-44ec-84fb-9be6a53718f9 admin admin] PATH_INFO: `/v3/projects/0c484252c6e543fcb5b380854c3b730a` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:34:59.874969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cc244-cd55-44ec-84fb-9be6a53718f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c484252c6e543fcb5b380854c3b730a)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:34:59.927538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING keystone.common.rbac_enforcer.enforcer [None req-350cc244-cd55-44ec-84fb-9be6a53718f9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 15:34:59.928187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cc244-cd55-44ec-84fb-9be6a53718f9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:34:59.932741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Mon Aug 1 15:34:59 2022] GET /identity/v3/projects/0c484252c6e543fcb5b380854c3b730a => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:01.957906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b756-d23c-45ab-833f-52df9f572e30 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:01.958718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b756-d23c-45ab-833f-52df9f572e30 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:01.958878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b756-d23c-45ab-833f-52df9f572e30 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:01.963150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:01.971504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd489bb6-a9fd-4d60-ae1b-e509d11d95b5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:01.972096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd489bb6-a9fd-4d60-ae1b-e509d11d95b5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:01.972096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd489bb6-a9fd-4d60-ae1b-e509d11d95b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:01.992707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-cd489bb6-a9fd-4d60-ae1b-e509d11d95b5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:01.994284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cd489bb6-a9fd-4d60-ae1b-e509d11d95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:02.002303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 01 15:35:02.024724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b756-d23c-45ab-833f-52df9f572e30 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:02.044672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b756-d23c-45ab-833f-52df9f572e30 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:02.050891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62496a91-aee7-4309-8d47-ac0ba77c6a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:02.051534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496a91-aee7-4309-8d47-ac0ba77c6a58 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:02.051818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496a91-aee7-4309-8d47-ac0ba77c6a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:02.052094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496a91-aee7-4309-8d47-ac0ba77c6a58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:02.061856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62496a91-aee7-4309-8d47-ac0ba77c6a58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:02.063686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62496a91-aee7-4309-8d47-ac0ba77c6a58 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:02.073182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Mon Aug 1 15:35:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:02.079707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd489bb6-a9fd-4d60-ae1b-e509d11d95b5 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:02.096498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd489bb6-a9fd-4d60-ae1b-e509d11d95b5 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:02.103470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfe09c-0901-4294-b7be-6991a2221044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:02.105217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe09c-0901-4294-b7be-6991a2221044 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:02.105887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe09c-0901-4294-b7be-6991a2221044 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:02.106407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe09c-0901-4294-b7be-6991a2221044 admin admin] PATH_INFO: `/v3/users/c6476155f7c9405fac6f2d48d97cbd58` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:02.108734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe09c-0901-4294-b7be-6991a2221044 admin admin] RBAC: Authorizing `identity:get_user(user_id=c6476155f7c9405fac6f2d48d97cbd58)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:02.112297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe09c-0901-4294-b7be-6991a2221044 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:02.115243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Mon Aug 1 15:35:02 2022] GET /identity/v3/users/c6476155f7c9405fac6f2d48d97cbd58 => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:04.275437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37ec3-2691-4b12-a966-969d61c66e0a None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.276140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37ec3-2691-4b12-a966-969d61c66e0a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.276140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37ec3-2691-4b12-a966-969d61c66e0a None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.278428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:04.288034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b076a-2580-4f34-915e-cbb7d98afb7e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.288557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b076a-2580-4f34-915e-cbb7d98afb7e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.288640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b076a-2580-4f34-915e-cbb7d98afb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.290073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7a74-db8d-40e9-bddc-6326210cfab6 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.290575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7a74-db8d-40e9-bddc-6326210cfab6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.291076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7a74-db8d-40e9-bddc-6326210cfab6 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.293823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:04.299730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.300070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.300349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.310323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1d9b076a-2580-4f34-915e-cbb7d98afb7e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:04.311623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1d9b076a-2580-4f34-915e-cbb7d98afb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:04.344005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG passlib.handlers.bcrypt [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92564) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 15:35:04.344413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG passlib.handlers.bcrypt [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92564) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 15:35:04.390484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:04.392122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:04.406087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:04.428614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b076a-2580-4f34-915e-cbb7d98afb7e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:04.465100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:04.517222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:04.545124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:04.556544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b076a-2580-4f34-915e-cbb7d98afb7e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:04.593207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:04.593924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.594206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.594484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.659580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a160e92-0ee3-401f-b30f-506e60396a7b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:04.662146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:04.679579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:04.681085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:04.707286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:04.712198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:04.713909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.714409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.714902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.733600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:04.742991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:04.743991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:04.744956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 8/14] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:04.752831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:04.804680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 7/15] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:04.811176 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:04.870763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450be39-7ac5-4f5e-869d-47c6148b26d2 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:04.913720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:04.914355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.914641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.914921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.915655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:04.915967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:04.918134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:04.928965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8730e-5a88-4683-8c83-57180da3851f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:04.931699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 9/16] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:04.938711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:04.953781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:04.965920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:04.970595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:04.970595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:04.970595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:04.980987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:04.981221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:04.983838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:35:05.011250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:05.012192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:05.013009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:35:05.013009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:35:05.013009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:35:05.013009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:05.013009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 8/17] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:05.018991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:05.072703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed552e-4267-4a7d-8ea7-77cc1576af58 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:05.112289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:05.112956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:05.113247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:05.113552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] PATH_INFO: `/v3/users/c6476155f7c9405fac6f2d48d97cbd58` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:05.115172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] RBAC: Authorizing `identity:get_user(user_id=c6476155f7c9405fac6f2d48d97cbd58)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:05.116667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:05.118685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:04 2022] GET /identity/v3/users/c6476155f7c9405fac6f2d48d97cbd58 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:05.126892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:05.252973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:05.261424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4c902-b0ce-4875-a1e9-b5bbe4f2844d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:05.270508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442954-6fed-45f4-b559-f32d725606a5 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:05.315630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:05.316629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:05.317058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:05.317552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:05.319459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:05.322094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:05.322675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971a193-586c-46e2-ac8d-36d62c83b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:05.323719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971a193-586c-46e2-ac8d-36d62c83b320 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:05.324104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971a193-586c-46e2-ac8d-36d62c83b320 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:05.325222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971a193-586c-46e2-ac8d-36d62c83b320 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:05.325404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 11/19] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:05.325898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971a193-586c-46e2-ac8d-36d62c83b320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:05.326538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971a193-586c-46e2-ac8d-36d62c83b320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:05.329140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971a193-586c-46e2-ac8d-36d62c83b320 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:05.334348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:05.362904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 9/20] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:05.475721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d5a4-7f9d-4282-94cc-f0a2f20d33af None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:05.543745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b13c7-ab29-4783-84f8-878c3a70cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:05.544810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b13c7-ab29-4783-84f8-878c3a70cda5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:05.545308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b13c7-ab29-4783-84f8-878c3a70cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:05.545844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b13c7-ab29-4783-84f8-878c3a70cda5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:05.547360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b13c7-ab29-4783-84f8-878c3a70cda5 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.domain.id=default, user.id=c6476155f7c9405fac6f2d48d97cbd58) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:05.547932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b13c7-ab29-4783-84f8-878c3a70cda5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:05.550712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b13c7-ab29-4783-84f8-878c3a70cda5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:05.561598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 12/21] 10.222.0.77 () {56 vars in 1322 bytes} [Mon Aug 1 15:35:05 2022] GET /identity/v3/role_assignments?user.id=c6476155f7c9405fac6f2d48d97cbd58&scope.domain.id=default&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 233 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:08.378594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5fc0d-64ff-410b-a9ec-423a49762a39 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:08.380142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5fc0d-64ff-410b-a9ec-423a49762a39 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:08.380963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5fc0d-64ff-410b-a9ec-423a49762a39 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:08.385722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 10/22] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:08.390239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899ea1-4dcf-4d20-9f18-826adba1c699 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:08.390960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899ea1-4dcf-4d20-9f18-826adba1c699 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:08.390960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899ea1-4dcf-4d20-9f18-826adba1c699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:08.432742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a7899ea1-4dcf-4d20-9f18-826adba1c699 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:08.434902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a7899ea1-4dcf-4d20-9f18-826adba1c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:08.465849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:08.547875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 13/23] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:08.611910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5fc0d-64ff-410b-a9ec-423a49762a39 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:08.655116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:08.758432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5fc0d-64ff-410b-a9ec-423a49762a39 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:08.841653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e2122-1f55-4d4d-ad6a-4669ccaa0526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:08.842577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e2122-1f55-4d4d-ad6a-4669ccaa0526 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:08.843028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e2122-1f55-4d4d-ad6a-4669ccaa0526 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:08.843492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e2122-1f55-4d4d-ad6a-4669ccaa0526 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:08.844732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e2122-1f55-4d4d-ad6a-4669ccaa0526 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:08.846634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e2122-1f55-4d4d-ad6a-4669ccaa0526 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:08.849199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cd19-4c79-4b30-adba-904571420c0a None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:08.849743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cd19-4c79-4b30-adba-904571420c0a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:08.850204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cd19-4c79-4b30-adba-904571420c0a None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:08.852620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 14/24] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:08.860638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a72c-a40f-4b94-bd99-73bff40ede4b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:08.861031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a72c-a40f-4b94-bd99-73bff40ede4b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:08.861266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a72c-a40f-4b94-bd99-73bff40ede4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:08.896442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b656a72c-a40f-4b94-bd99-73bff40ede4b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:08.898349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b656a72c-a40f-4b94-bd99-73bff40ede4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:09.039134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 15/25] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:09.121989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656a72c-a40f-4b94-bd99-73bff40ede4b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:09.129700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 11/26] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 1 15:35:08 2022] POST /identity/v3/roles => generated 225 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:09.263173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:09.289552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656a72c-a40f-4b94-bd99-73bff40ede4b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:09.341451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:09.342164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:09.342449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:09.342731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:09.367533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd7655-d085-49f7-9d1e-c55550e5acb6 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:09.368165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd7655-d085-49f7-9d1e-c55550e5acb6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:09.368670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd7655-d085-49f7-9d1e-c55550e5acb6 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:09.370481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 12/27] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:09.375394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:09.377313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e60a1-fc53-42e3-947f-d56a1c53cf2b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:09.377904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e60a1-fc53-42e3-947f-d56a1c53cf2b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:09.378563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e60a1-fc53-42e3-947f-d56a1c53cf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:09.385573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:09.414751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c09e60a1-fc53-42e3-947f-d56a1c53cf2b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:35:09.416024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:09.417112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:09.418756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:35:09.418756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:35:09.418756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:35:09.418756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:09.418756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 16/28] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:09.420362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c09e60a1-fc53-42e3-947f-d56a1c53cf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:09.425545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:09.607379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 13/29] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:09.637656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e60a1-fc53-42e3-947f-d56a1c53cf2b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:09.689126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:09.809487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e29875-65b3-49db-aa10-22cef9959ddc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:09.850127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e60a1-fc53-42e3-947f-d56a1c53cf2b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:09.879244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d8f4d-96d7-4fa1-95bf-2dd0321f1c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:09.880761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8f4d-96d7-4fa1-95bf-2dd0321f1c7c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:09.881500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8f4d-96d7-4fa1-95bf-2dd0321f1c7c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:09.882490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8f4d-96d7-4fa1-95bf-2dd0321f1c7c None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:09.884169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8f4d-96d7-4fa1-95bf-2dd0321f1c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:09.885672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8f4d-96d7-4fa1-95bf-2dd0321f1c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:09.888726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f9d93-3271-4280-972d-bbbc3e63ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:09.889342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9d93-3271-4280-972d-bbbc3e63ab52 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:09.889662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9d93-3271-4280-972d-bbbc3e63ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:09.889873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8f4d-96d7-4fa1-95bf-2dd0321f1c7c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:09.890021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9d93-3271-4280-972d-bbbc3e63ab52 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:09.890669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f9d93-3271-4280-972d-bbbc3e63ab52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:09.892232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f9d93-3271-4280-972d-bbbc3e63ab52 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:09.911984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:09.927435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 17/30] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:09.930262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44db1-df83-4dd7-9769-edca0350822b None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:09.931048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44db1-df83-4dd7-9769-edca0350822b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:09.931755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44db1-df83-4dd7-9769-edca0350822b None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:09.934942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 18/31] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:09.936318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44db1-df83-4dd7-9769-edca0350822b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:09.976054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 14/32] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 1 15:35:09 2022] POST /identity/v3/roles => generated 219 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:35:09.980612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a8fe-8786-4bce-bdfb-4e8bfe10f4d3 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:09.981862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a8fe-8786-4bce-bdfb-4e8bfe10f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:09.983077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a8fe-8786-4bce-bdfb-4e8bfe10f4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.034754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2355a8fe-8786-4bce-bdfb-4e8bfe10f4d3 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:10.036407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2355a8fe-8786-4bce-bdfb-4e8bfe10f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:10.153669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44db1-df83-4dd7-9769-edca0350822b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:10.165038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 15/33] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:10.167817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7959c9-e8a2-4931-8ac5-c23f335db6aa None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.168553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7959c9-e8a2-4931-8ac5-c23f335db6aa None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.169337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7959c9-e8a2-4931-8ac5-c23f335db6aa None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.172091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 16/34] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:10.174649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814b237-97ba-4c61-aaaa-c69b6a7ce6b7 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.175497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814b237-97ba-4c61-aaaa-c69b6a7ce6b7 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.176266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814b237-97ba-4c61-aaaa-c69b6a7ce6b7 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.178794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 17/35] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:10.180480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55b6ed-2e20-47bb-a547-372428dd4c8c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.181124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55b6ed-2e20-47bb-a547-372428dd4c8c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.181698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55b6ed-2e20-47bb-a547-372428dd4c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.216079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5d55b6ed-2e20-47bb-a547-372428dd4c8c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:10.218192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5d55b6ed-2e20-47bb-a547-372428dd4c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:10.220816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:10.221876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.222316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.222755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.224622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:10.225262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:10.237588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:10.335340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 18/36] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:10.337379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385812e2-c8b3-47b3-a6a5-60d043d1faf5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.337915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385812e2-c8b3-47b3-a6a5-60d043d1faf5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.338439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385812e2-c8b3-47b3-a6a5-60d043d1faf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.358530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-385812e2-c8b3-47b3-a6a5-60d043d1faf5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:10.359745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-385812e2-c8b3-47b3-a6a5-60d043d1faf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:10.444278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 19/37] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:10.445441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385812e2-c8b3-47b3-a6a5-60d043d1faf5 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:10.487555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 19/38] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:35:09 2022] POST /identity/v3/projects => generated 301 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:10.488576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:10.587349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:10.595176 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:10.643799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385812e2-c8b3-47b3-a6a5-60d043d1faf5 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:10.674115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0350aa-3c61-41f6-8483-be4a7e0f4645 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:10.703528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:10.704105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.704391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.704672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.725651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:10.732618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:10.734432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:10.735778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 20/39] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:10.739799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:10.744175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:10.744970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.745368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.745760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.746587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:10.748399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:10.890872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe09f0-bf52-4962-b5ce-74205d33c1a7 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:10.894717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 20/40] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 1 15:35:10 2022] POST /identity/v3/roles => generated 223 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:10.904982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:10.953956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:10.954546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:10.954834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:10.955116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:10.956504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:10.958175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:10.959844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 21/41] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:10.967207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:10.971080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:11.081119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c99d4-d6d0-4d22-bacf-1a5b776d40ce None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:11.103205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:11.148176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:11.149253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:11.149832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:11.150323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:11.151650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:11.152150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:11.154635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:11.163204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a236bc-c116-4acd-b641-ec3204d966a9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:11.172375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 21/42] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:11.179122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:11.217297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:11.218517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:11.219021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:11.219405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:11.220509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:11.222886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:11.331341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 22/43] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:35:10 2022] POST /identity/v3/projects => generated 312 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:35:11.332238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1971f53-f0b7-4f11-b979-03dd557f8f97 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:11.378615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:11.379294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:11.379580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:11.379862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] PATH_INFO: `/v3/users/c6476155f7c9405fac6f2d48d97cbd58` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:11.381199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] RBAC: Authorizing `identity:get_user(user_id=c6476155f7c9405fac6f2d48d97cbd58)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:11.382767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:11.391508 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 22/44] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:11 2022] GET /identity/v3/users/c6476155f7c9405fac6f2d48d97cbd58 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:11.393463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:11.475841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:11.529913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e581db-fe26-4357-8fb8-eb241af2b817 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:11.574246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b01ca-6bbe-4a22-8319-2d2542f6898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:11.574925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b01ca-6bbe-4a22-8319-2d2542f6898e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:11.575217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b01ca-6bbe-4a22-8319-2d2542f6898e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:11.575503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b01ca-6bbe-4a22-8319-2d2542f6898e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:11.576685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b01ca-6bbe-4a22-8319-2d2542f6898e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:11.578324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b01ca-6bbe-4a22-8319-2d2542f6898e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:11.580024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 23/45] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:11.586202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:11.649854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:11.760687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbce91-09f3-47bb-ad97-288c73fea0dc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:11.822151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428011b6-fc35-4cc4-8ac6-c8cd17fa2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:11.823456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428011b6-fc35-4cc4-8ac6-c8cd17fa2569 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:11.823971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428011b6-fc35-4cc4-8ac6-c8cd17fa2569 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:11.824476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428011b6-fc35-4cc4-8ac6-c8cd17fa2569 None admin] PATH_INFO: `/v3/domains/default/users/c6476155f7c9405fac6f2d48d97cbd58/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:11.828269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428011b6-fc35-4cc4-8ac6-c8cd17fa2569 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c6476155f7c9405fac6f2d48d97cbd58, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:11.831101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428011b6-fc35-4cc4-8ac6-c8cd17fa2569 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:11.908504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 23/46] 10.222.0.77 () {58 vars in 1361 bytes} [Mon Aug 1 15:35:11 2022] PUT /identity/v3/domains/default/users/c6476155f7c9405fac6f2d48d97cbd58/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:13.566277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb641-a146-4f68-8148-4e499cdd4ac6 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:13.566805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb641-a146-4f68-8148-4e499cdd4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:13.566805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb641-a146-4f68-8148-4e499cdd4ac6 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:13.568139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 24/47] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:13.574110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549caf84-1344-476e-a224-b9619ccf6a52 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:13.574841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549caf84-1344-476e-a224-b9619ccf6a52 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:13.574841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549caf84-1344-476e-a224-b9619ccf6a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:13.600649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-549caf84-1344-476e-a224-b9619ccf6a52 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:13.603234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-549caf84-1344-476e-a224-b9619ccf6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:13.716246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 24/48] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:13.740070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fb641-a146-4f68-8148-4e499cdd4ac6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:13.868567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fb641-a146-4f68-8148-4e499cdd4ac6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:13.896597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:13.913024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3163-66c7-4d41-8cbf-755dc644b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:13.914051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3163-66c7-4d41-8cbf-755dc644b38c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:13.914503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3163-66c7-4d41-8cbf-755dc644b38c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:13.914952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3163-66c7-4d41-8cbf-755dc644b38c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:13.916816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d3163-66c7-4d41-8cbf-755dc644b38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:13.919364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d3163-66c7-4d41-8cbf-755dc644b38c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:13.922386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 25/49] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:13.930070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549caf84-1344-476e-a224-b9619ccf6a52 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:13.975005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:14.074412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b903e-419c-48cc-a085-2a4da6fd120b None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.074666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b903e-419c-48cc-a085-2a4da6fd120b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.074966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b903e-419c-48cc-a085-2a4da6fd120b None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.076340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 26/50] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:14.082035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691b3b-dd6f-4466-8e67-f2dad0754d69 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.082332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691b3b-dd6f-4466-8e67-f2dad0754d69 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.082616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691b3b-dd6f-4466-8e67-f2dad0754d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.094433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549caf84-1344-476e-a224-b9619ccf6a52 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:14.106193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-21691b3b-dd6f-4466-8e67-f2dad0754d69 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:14.106193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-21691b3b-dd6f-4466-8e67-f2dad0754d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:14.143015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:14.143880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.144359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.144826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.145929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:14.148516 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:14.194342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 27/51] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:14.217863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691b3b-dd6f-4466-8e67-f2dad0754d69 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:14.280967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 25/52] 10.222.0.77 () {60 vars in 1140 bytes} [Mon Aug 1 15:35:13 2022] POST /identity/v3/projects => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:35:14.363137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691b3b-dd6f-4466-8e67-f2dad0754d69 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:14.390440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:14.409400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:14.409997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.410283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.410562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.428535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:14.437939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:14.439561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:14.440305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 28/53] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:14.449460 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:14.551740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:14.578742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882d27-e40b-46f4-aa8c-849978e46639 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:14.637400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:14.638837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.639613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.640162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.641903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:14.642463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:14.645024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:14.661627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 26/54] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:14.669726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:14.800659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12524-19fa-49d2-ad3e-48e3baca103e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:14.843507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:14.844359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:14.844767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:14.845183 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] PATH_INFO: `/v3/users/c6476155f7c9405fac6f2d48d97cbd58` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:14.846844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] RBAC: Authorizing `identity:get_user(user_id=c6476155f7c9405fac6f2d48d97cbd58)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:14.848554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:14.850420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 29/55] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:14 2022] GET /identity/v3/users/c6476155f7c9405fac6f2d48d97cbd58 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:14.856368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:14.972298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd036d0-3917-4815-a319-776123e88a55 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:15.011530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876153d-89dd-47ab-a7d5-ec889f87a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:15.012198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876153d-89dd-47ab-a7d5-ec889f87a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:15.012487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876153d-89dd-47ab-a7d5-ec889f87a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:15.012773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876153d-89dd-47ab-a7d5-ec889f87a3b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:15.014053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876153d-89dd-47ab-a7d5-ec889f87a3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:15.016268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876153d-89dd-47ab-a7d5-ec889f87a3b5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:15.019291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 27/56] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:15.026287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:15.094392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:15.158401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785837de-66b9-48c0-bfd3-16723986c733 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:15.210383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc5710-1fc7-4eae-bf73-33f9f572cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:15.211037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5710-1fc7-4eae-bf73-33f9f572cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:15.211323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5710-1fc7-4eae-bf73-33f9f572cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:15.211604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5710-1fc7-4eae-bf73-33f9f572cfc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:15.212433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc5710-1fc7-4eae-bf73-33f9f572cfc2 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.domain.id=default, user.id=c6476155f7c9405fac6f2d48d97cbd58) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:15.212801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc5710-1fc7-4eae-bf73-33f9f572cfc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:15.215079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc5710-1fc7-4eae-bf73-33f9f572cfc2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:15.223867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 30/57] 10.222.0.77 () {56 vars in 1322 bytes} [Mon Aug 1 15:35:15 2022] GET /identity/v3/role_assignments?user.id=c6476155f7c9405fac6f2d48d97cbd58&scope.domain.id=default&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 530 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:16.712501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a9cba-c904-46bb-b658-524fc29e97b8 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:16.713330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a9cba-c904-46bb-b658-524fc29e97b8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:16.713657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a9cba-c904-46bb-b658-524fc29e97b8 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:16.715100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 28/58] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:16.723018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c8e1f-b64a-405d-ad08-f5e19e5b5fdc None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:16.725201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c8e1f-b64a-405d-ad08-f5e19e5b5fdc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:16.725201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c8e1f-b64a-405d-ad08-f5e19e5b5fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:16.746454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3a1c8e1f-b64a-405d-ad08-f5e19e5b5fdc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:16.747706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3a1c8e1f-b64a-405d-ad08-f5e19e5b5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:16.834996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 31/59] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:16.864825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a9cba-c904-46bb-b658-524fc29e97b8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:16.882881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:16.984767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a9cba-c904-46bb-b658-524fc29e97b8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:17.031013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116474f2-9daa-48f5-b815-feb122ef12e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:17.031681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116474f2-9daa-48f5-b815-feb122ef12e7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:17.031952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116474f2-9daa-48f5-b815-feb122ef12e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:17.032232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116474f2-9daa-48f5-b815-feb122ef12e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:17.033418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116474f2-9daa-48f5-b815-feb122ef12e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:17.034961 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116474f2-9daa-48f5-b815-feb122ef12e7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:17.036619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 29/60] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:17.043652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c8e1f-b64a-405d-ad08-f5e19e5b5fdc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:17.091027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:17.155879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c8e1f-b64a-405d-ad08-f5e19e5b5fdc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:17.199333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880b7ec-df98-4468-9db0-13baf7348207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:17.200113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880b7ec-df98-4468-9db0-13baf7348207 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:17.200489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880b7ec-df98-4468-9db0-13baf7348207 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:17.200885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880b7ec-df98-4468-9db0-13baf7348207 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:17.201734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880b7ec-df98-4468-9db0-13baf7348207 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:17.203433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880b7ec-df98-4468-9db0-13baf7348207 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:17.329361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 32/61] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:35:17 2022] POST /identity/v3/users => generated 275 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:21.105766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ee34e-cff1-43c2-a3fe-be4396a3536e None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.106813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ee34e-cff1-43c2-a3fe-be4396a3536e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.107310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ee34e-cff1-43c2-a3fe-be4396a3536e None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.108933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 30/62] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:21.122666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7883-e652-4658-8acc-4c43270ae7c2 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.123302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7883-e652-4658-8acc-4c43270ae7c2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.123302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7883-e652-4658-8acc-4c43270ae7c2 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.124547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8a65-6f4c-4110-8341-aa392dd36e16 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.124749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 33/63] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:21.125240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8a65-6f4c-4110-8341-aa392dd36e16 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.125774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8a65-6f4c-4110-8341-aa392dd36e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.131115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2465-4f59-41a1-aa0d-2e092a7077c0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.131403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2465-4f59-41a1-aa0d-2e092a7077c0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.131918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2465-4f59-41a1-aa0d-2e092a7077c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.155930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-581d8a65-6f4c-4110-8341-aa392dd36e16 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:21.158837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-581d8a65-6f4c-4110-8341-aa392dd36e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:21.166492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8dda2465-4f59-41a1-aa0d-2e092a7077c0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:21.168481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8dda2465-4f59-41a1-aa0d-2e092a7077c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:21.305544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 31/64] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:21.333912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 34/65] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:21.347115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d8a65-6f4c-4110-8341-aa392dd36e16 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:21.363803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2465-4f59-41a1-aa0d-2e092a7077c0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:21.379253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:21.421017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:21.527786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d8a65-6f4c-4110-8341-aa392dd36e16 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:21.540035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2465-4f59-41a1-aa0d-2e092a7077c0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:21.580871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31a60-ffa2-43b0-9e26-58d2cb285c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:21.581804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31a60-ffa2-43b0-9e26-58d2cb285c76 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.582228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31a60-ffa2-43b0-9e26-58d2cb285c76 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.582648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31a60-ffa2-43b0-9e26-58d2cb285c76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.585560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:21.586709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.586996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.587324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.595800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31a60-ffa2-43b0-9e26-58d2cb285c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:21.601360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-6ca31a60-ffa2-43b0-9e26-58d2cb285c76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:21.601794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:21.602621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:21.603421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:21.605804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 35/66] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:21.606753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:21.607579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:21.608320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 32/67] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:21.612520 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:21.614874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca4fd-69fc-4651-a63a-0642261726eb None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.615110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca4fd-69fc-4651-a63a-0642261726eb None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.615396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca4fd-69fc-4651-a63a-0642261726eb None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.623803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 36/68] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:21.623803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ca4fd-69fc-4651-a63a-0642261726eb None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:21.708339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:21.746241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac5e05-123a-4788-97fb-042a04670c2b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:21.792018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123487c-ada4-4d25-9f9b-3ec265375f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:21.792976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123487c-ada4-4d25-9f9b-3ec265375f7a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.793487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123487c-ada4-4d25-9f9b-3ec265375f7a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.793981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123487c-ada4-4d25-9f9b-3ec265375f7a None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.794912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123487c-ada4-4d25-9f9b-3ec265375f7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:21.795403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123487c-ada4-4d25-9f9b-3ec265375f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:21.795728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:21.797256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123487c-ada4-4d25-9f9b-3ec265375f7a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:21.813609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 33/69] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:21.815421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e320df-c3fb-4217-a5f5-e121db33ab5f None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.815931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e320df-c3fb-4217-a5f5-e121db33ab5f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.816416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e320df-c3fb-4217-a5f5-e121db33ab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.818047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ca4fd-69fc-4651-a63a-0642261726eb None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:21.839760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-58e320df-c3fb-4217-a5f5-e121db33ab5f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:21.841384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-58e320df-c3fb-4217-a5f5-e121db33ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:21.864159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:21.865189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.865652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.866090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.866974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:21.867291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:21.869311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:21.883684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 37/70] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:21.883684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:21.947570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 34/71] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:21.953485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738783d-d7d3-4207-a561-93f280062a71 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:21.953485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738783d-d7d3-4207-a561-93f280062a71 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:21.953485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738783d-d7d3-4207-a561-93f280062a71 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:21.953485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 35/72] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:21.957574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738783d-d7d3-4207-a561-93f280062a71 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.047357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a03c-21ca-4341-9e97-fce7a3b8e255 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.051491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.086500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f625a79-8529-4f6b-97e2-26f0b141d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.087157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f625a79-8529-4f6b-97e2-26f0b141d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.087485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f625a79-8529-4f6b-97e2-26f0b141d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.087763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f625a79-8529-4f6b-97e2-26f0b141d2e0 None admin] PATH_INFO: `/v3/users/c6476155f7c9405fac6f2d48d97cbd58` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.088993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f625a79-8529-4f6b-97e2-26f0b141d2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=c6476155f7c9405fac6f2d48d97cbd58)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:22.090498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f625a79-8529-4f6b-97e2-26f0b141d2e0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:22.092170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 38/73] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:21 2022] GET /identity/v3/users/c6476155f7c9405fac6f2d48d97cbd58 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:22.095069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35202c-1cfa-4816-957f-ee03c13a01c5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.095363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35202c-1cfa-4816-957f-ee03c13a01c5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.095651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35202c-1cfa-4816-957f-ee03c13a01c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.105469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738783d-d7d3-4207-a561-93f280062a71 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.115799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7b35202c-1cfa-4816-957f-ee03c13a01c5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:22.116952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7b35202c-1cfa-4816-957f-ee03c13a01c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:22.131742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.141197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.144556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.144556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.144556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.159582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:22.161075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:22.163269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 36/74] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:21 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:22.163786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.200031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 39/75] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:22.202391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c25ee-29b5-4ac4-910a-e4347e409a33 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.202870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c25ee-29b5-4ac4-910a-e4347e409a33 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.203324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c25ee-29b5-4ac4-910a-e4347e409a33 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.205546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 40/76] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:22.206504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c25ee-29b5-4ac4-910a-e4347e409a33 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.291232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385f82c-1f37-46c7-86f2-7274da9fa9b3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.314311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.330638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.331308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.331600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.331882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.343176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:22.345905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c25ee-29b5-4ac4-910a-e4347e409a33 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:22.348392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:22.349316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:22.350194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 37/77] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:22.350825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.395937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0cde-ee91-4048-b6cb-9084ee4c9578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.396479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0cde-ee91-4048-b6cb-9084ee4c9578 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.396772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0cde-ee91-4048-b6cb-9084ee4c9578 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.397053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0cde-ee91-4048-b6cb-9084ee4c9578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.416623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.464431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a426d-915e-45a4-9099-9efa5d716dca None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.470996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0cde-ee91-4048-b6cb-9084ee4c9578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:22.472515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0cde-ee91-4048-b6cb-9084ee4c9578 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:22.503217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.504279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.504732 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.505154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.557856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.578010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:22.580202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:22.592161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 41/78] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:22.594134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8021-7d99-41a1-808e-b1e4c564da55 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.594429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8021-7d99-41a1-808e-b1e4c564da55 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.594710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8021-7d99-41a1-808e-b1e4c564da55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.614300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-977b8021-7d99-41a1-808e-b1e4c564da55 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:22.615519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-977b8021-7d99-41a1-808e-b1e4c564da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:22.661679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.686534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 38/79] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:22.687322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.689760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 42/80] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:22.690768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b8021-7d99-41a1-808e-b1e4c564da55 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.784299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.803686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b8021-7d99-41a1-808e-b1e4c564da55 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.804076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85fa30-608d-469d-a98c-630c843f16ac None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.840440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.841098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.841390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.841712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.842961 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:22.844437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:22.846130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 39/81] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:22.846930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.849927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.850569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.850863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.851146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:22.851890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:22.852199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:22.854178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:22.865547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 43/82] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:22.866416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:22.915923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:22.961782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5448e6d-cedd-469d-8440-d437e13f6b0f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.995620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803556e-a3de-4ad8-b2a3-f2e76106284c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:22.998465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:22.999129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:22.999418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:22.999702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.000942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:23.002478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:23.004189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 40/83] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:22 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:23.004971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.035995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:23.052489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.053157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.053448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.053761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.055261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:23.056762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:23.058506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 44/84] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:22 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:23.059695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.139049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc321a3-6be1-48df-8ae4-dd518d79416a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:23.172294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457754ec-603b-4707-9d6b-76facead6113 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:23.178091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.178747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.179032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.179305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.182341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:23.193027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:23.199479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:23.200528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:23.201272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 41/85] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:23.201933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.210796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.212900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.212900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.212900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.213237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:23.214748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:23.304690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:23.306985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 45/86] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:35:23 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:23.313200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.338182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8b151-8b95-4f1a-af24-d39eeb5fd508 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:23.389914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.390589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.390903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.391165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.392578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:23.395095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:23.398120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 42/87] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:23 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:23.399524 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.461376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79975ec9-ae81-4b96-b5ae-ecb2e6b507b4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:23.504462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.505105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.505440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.505732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.506557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=c6476155f7c9405fac6f2d48d97cbd58) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:23.506877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:23.508400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:23.520105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 46/88] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:23 2022] GET /identity/v3/role_assignments?user.id=c6476155f7c9405fac6f2d48d97cbd58&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:23.520105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.558082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8569-3230-4ea0-aa6b-00a5eb741111 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:23.562937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:23.620681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.621960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.622513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.622971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.624108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=70961e1242bf4fa29c96ec8ec07acb33) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:23.624588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:23.627792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:23.642303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 43/89] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:23 2022] GET /identity/v3/role_assignments?user.id=70961e1242bf4fa29c96ec8ec07acb33&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=da9b6fc593c747e48d031adf8b20978d => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:23.643486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.662393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:23.731363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484077-0540-48ef-ab3f-bf08a2a4cf74 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:23.815717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.816373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.816657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.816989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:23.817760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:23.818069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:23.819865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:23.836568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244edf43-9c7e-4455-b299-cf759553b654 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:23.840671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 47/90] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:23.847903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:23.911763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:23.912405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:23.912736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:23.913017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:24.036690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:24.054247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b300-57ff-4e28-8f83-ddd3634626f7 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:24.072984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:24.075484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:24.098688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:24.135778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:24.136455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:24.137544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:24.137964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:24.143360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:24.145587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:24.149642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 48/91] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:23 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:24.156315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:24.335621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda233c1-d964-4498-8779-d4b526c540bf None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:24.351350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 44/92] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:24.357374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:24.422363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:24.423320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:24.423753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:24.424184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:24.489758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:24.567922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:24.569491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:24.631067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f0bd-87f2-4eee-83dc-042b26e1187d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:24.653271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:24.733605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:24.734283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:24.734573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:24.734889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:24.745552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:24.745552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:24.745552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 45/93] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:24 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:24.754493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:24.830274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 49/94] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:24.836344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:24.986763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1d27-ee69-4d39-93f0-6e62abd7f6fa None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:25.007948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:25.072038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:25.072363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:25.072608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:25.072766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:25.073599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] RBAC: Adding query filter params (role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=70961e1242bf4fa29c96ec8ec07acb33) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:25.073919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:25.075417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:25.089161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 46/95] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:24 2022] GET /identity/v3/role_assignments?user.id=70961e1242bf4fa29c96ec8ec07acb33&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:25.107860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80883-00a1-4502-9335-1eca250a9161 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:25.165311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fa3e-31dc-409f-8a5b-609149aeafff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:25.166017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fa3e-31dc-409f-8a5b-609149aeafff None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:25.166304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fa3e-31dc-409f-8a5b-609149aeafff None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:25.166586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fa3e-31dc-409f-8a5b-609149aeafff None admin] PATH_INFO: `/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:25.167828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fa3e-31dc-409f-8a5b-609149aeafff None admin] RBAC: Authorizing `identity:get_project(project_id=6fc2e7a6f09648ddbff9be53787eb31a)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:25.169362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fa3e-31dc-409f-8a5b-609149aeafff None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:25.171201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 50/96] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:24 2022] GET /identity/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a => generated 312 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:25.177914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:25.277013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:25.375779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11463-2dca-464f-a3f7-7a3124246ef9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:25.428983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc93f6c-5f1f-4d0b-beaa-f051047b069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:25.429730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc93f6c-5f1f-4d0b-beaa-f051047b069a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:25.430020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc93f6c-5f1f-4d0b-beaa-f051047b069a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:25.430304 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc93f6c-5f1f-4d0b-beaa-f051047b069a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:25.431658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc93f6c-5f1f-4d0b-beaa-f051047b069a None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=6fc2e7a6f09648ddbff9be53787eb31a, user.id=70961e1242bf4fa29c96ec8ec07acb33) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:25.431976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc93f6c-5f1f-4d0b-beaa-f051047b069a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:25.433550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc93f6c-5f1f-4d0b-beaa-f051047b069a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:25.440700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 47/97] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:25 2022] GET /identity/v3/role_assignments?user.id=70961e1242bf4fa29c96ec8ec07acb33&scope.project.id=6fc2e7a6f09648ddbff9be53787eb31a&role.id=da9b6fc593c747e48d031adf8b20978d => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:26.282397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113e0d-fbd2-409a-8731-f8af88edefa6 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.282896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113e0d-fbd2-409a-8731-f8af88edefa6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.282966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113e0d-fbd2-409a-8731-f8af88edefa6 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.284434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 51/98] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:26.295250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5492a-4e2c-494d-a790-367ce541d93a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.295771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5492a-4e2c-494d-a790-367ce541d93a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.296243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5492a-4e2c-494d-a790-367ce541d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.315272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-89b5492a-4e2c-494d-a790-367ce541d93a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:26.316866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-89b5492a-4e2c-494d-a790-367ce541d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:26.404293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 48/99] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:26.438719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27113e0d-fbd2-409a-8731-f8af88edefa6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:26.567611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27113e0d-fbd2-409a-8731-f8af88edefa6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:26.596215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:26.605011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074827e-63f6-4717-ae5d-80c65830c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:26.605690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074827e-63f6-4717-ae5d-80c65830c362 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.606059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074827e-63f6-4717-ae5d-80c65830c362 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.606387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074827e-63f6-4717-ae5d-80c65830c362 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.616651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074827e-63f6-4717-ae5d-80c65830c362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-0074827e-63f6-4717-ae5d-80c65830c362 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:26.621666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:26.622501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:26.623264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 52/100] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:26.628720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5492a-4e2c-494d-a790-367ce541d93a None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:26.668719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:26.718733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9156-632f-4c52-90f9-89bca55e28bd None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.719369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9156-632f-4c52-90f9-89bca55e28bd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.719846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9156-632f-4c52-90f9-89bca55e28bd None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.721419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 53/101] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:26.733259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e2ee5-1b9b-4a2d-9252-ab287f5e0214 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.733846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e2ee5-1b9b-4a2d-9252-ab287f5e0214 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.734318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e2ee5-1b9b-4a2d-9252-ab287f5e0214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.749632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5492a-4e2c-494d-a790-367ce541d93a None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:26.770727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4a8e2ee5-1b9b-4a2d-9252-ab287f5e0214 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:26.772251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4a8e2ee5-1b9b-4a2d-9252-ab287f5e0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:26.792275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:26.792918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.793343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.793653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.794380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:26.794708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:26.796093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:26.813814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 49/102] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:26.814711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:26.871836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 54/103] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:26.873039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673e076-bd47-4715-98c5-bb1a96dfc069 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.873329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673e076-bd47-4715-98c5-bb1a96dfc069 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.877778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673e076-bd47-4715-98c5-bb1a96dfc069 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.879126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 55/104] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:26.886807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3b4af-0279-4f7e-8655-73b16040bf12 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:26.887099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3b4af-0279-4f7e-8655-73b16040bf12 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:26.887378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3b4af-0279-4f7e-8655-73b16040bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:26.916642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-fdb3b4af-0279-4f7e-8655-73b16040bf12 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:26.918547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-fdb3b4af-0279-4f7e-8655-73b16040bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:26.994522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 56/105] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:26.995294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3b4af-0279-4f7e-8655-73b16040bf12 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.009916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:27.014873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ab4d-baec-4175-ad3c-c66453429738 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.043263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:27.061945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e20ce-4d85-427e-b061-7a9d9e1d9671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.063151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e20ce-4d85-427e-b061-7a9d9e1d9671 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.063688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e20ce-4d85-427e-b061-7a9d9e1d9671 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.064220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e20ce-4d85-427e-b061-7a9d9e1d9671 None admin] PATH_INFO: `/v3/users/10e49e34bbf14bcf937c04f3475ffd77` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.081334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e20ce-4d85-427e-b061-7a9d9e1d9671 None admin] RBAC: Authorizing `identity:get_user(user_id=10e49e34bbf14bcf937c04f3475ffd77)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:27.100975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e20ce-4d85-427e-b061-7a9d9e1d9671 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:27.100975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 50/106] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:26 2022] GET /identity/v3/users/10e49e34bbf14bcf937c04f3475ffd77 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:27.100975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903b730-bd71-4918-b4b0-1b19b49dd04f None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.100975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903b730-bd71-4918-b4b0-1b19b49dd04f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.100975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903b730-bd71-4918-b4b0-1b19b49dd04f None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.100975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 51/107] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:27.101579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903b730-bd71-4918-b4b0-1b19b49dd04f None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.101668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3b4af-0279-4f7e-8655-73b16040bf12 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.134863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.135427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.135748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.136022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.147377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:27.152702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:27.153790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:27.154905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 57/108] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:27.159606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.209069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903b730-bd71-4918-b4b0-1b19b49dd04f None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.253652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1693b6-aef6-45f0-bb53-7335b7f75d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.254303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1693b6-aef6-45f0-bb53-7335b7f75d65 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.254589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1693b6-aef6-45f0-bb53-7335b7f75d65 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.254872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1693b6-aef6-45f0-bb53-7335b7f75d65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.256579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1693b6-aef6-45f0-bb53-7335b7f75d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:27.258630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1693b6-aef6-45f0-bb53-7335b7f75d65 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:27.261196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 52/109] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:27.262120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ebe16-611e-4db3-bacb-c794648af761 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.262506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ebe16-611e-4db3-bacb-c794648af761 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.262786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ebe16-611e-4db3-bacb-c794648af761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.278775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010680-e247-4188-a042-d35b1f8ae172 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.284148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ba7ebe16-611e-4db3-bacb-c794648af761 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:27.285334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ba7ebe16-611e-4db3-bacb-c794648af761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:27.287257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:27.323191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:27.324826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.325625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.326051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.326404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.386586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 53/110] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:27.393216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ebe16-611e-4db3-bacb-c794648af761 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.404093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:27.405881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:27.521550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 58/111] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:27.521550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.526997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:27.552485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ebe16-611e-4db3-bacb-c794648af761 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.592233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.593329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.593823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.594396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.595316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:27.595857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:27.597622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:27.607654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 54/112] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:27.610305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.626769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:27.679651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b20efa-99f0-4269-89b9-88e18d010c93 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.719466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.720252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.720631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.721008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.721830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:27.723535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:27.737115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f060eee-dcdc-4593-91e1-6e0a4332d832 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:27.772778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:27.773733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:27.774164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:27.775098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:27.786189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:27.792605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:27.793660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:27.794605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:27.796546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 55/113] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:27.797460 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.811834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 59/114] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:35:27 2022] POST /identity/v3/projects => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:27.815134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:27.944766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:27.972234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:28.006428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c6a8-2555-4868-ba91-4354593046f8 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.024225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295ea6d-f12d-4c54-b1a5-ef0bcead10ec None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.052894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.053924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.054212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.054490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] PATH_INFO: `/v3/users/c6476155f7c9405fac6f2d48d97cbd58` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.055810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] RBAC: Authorizing `identity:get_user(user_id=c6476155f7c9405fac6f2d48d97cbd58)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.057593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.059340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 60/115] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:27 2022] GET /identity/v3/users/c6476155f7c9405fac6f2d48d97cbd58 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:28.062577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.068457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9146b7-fb75-40b7-a71c-f0f3aedf4521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.069258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9146b7-fb75-40b7-a71c-f0f3aedf4521 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.069588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9146b7-fb75-40b7-a71c-f0f3aedf4521 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.069873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9146b7-fb75-40b7-a71c-f0f3aedf4521 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.071077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9146b7-fb75-40b7-a71c-f0f3aedf4521 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.073199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9146b7-fb75-40b7-a71c-f0f3aedf4521 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.075281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 56/116] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:27 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:28.076484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611db6-dfe3-4c56-9244-e6c66e7d27d2 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.076756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611db6-dfe3-4c56-9244-e6c66e7d27d2 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.076949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611db6-dfe3-4c56-9244-e6c66e7d27d2 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.082305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 57/117] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:28.085617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1611db6-dfe3-4c56-9244-e6c66e7d27d2 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.184379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b0d43-cc9d-4cf0-a97c-8443487f9e3b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.212668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1611db6-dfe3-4c56-9244-e6c66e7d27d2 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.216291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:28.220202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.220981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.221275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.221582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.227167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:28.227167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.227167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.233227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 61/118] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:28.234457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.253221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747ceab-0d94-49ab-b59b-d93e187be247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.254237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747ceab-0d94-49ab-b59b-d93e187be247 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.254725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747ceab-0d94-49ab-b59b-d93e187be247 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.255244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747ceab-0d94-49ab-b59b-d93e187be247 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.256688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747ceab-0d94-49ab-b59b-d93e187be247 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.258506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747ceab-0d94-49ab-b59b-d93e187be247 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.261055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 58/119] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:28.262510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5d2f1-02bc-44fe-95b4-fb8ee453cb2b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.263062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5d2f1-02bc-44fe-95b4-fb8ee453cb2b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.263677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5d2f1-02bc-44fe-95b4-fb8ee453cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.282873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8fa5d2f1-02bc-44fe-95b4-fb8ee453cb2b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:28.284447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8fa5d2f1-02bc-44fe-95b4-fb8ee453cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:28.288012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:28.349073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae058-5591-4de5-bb94-31caf3b37611 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.364396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 59/120] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:28.365578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5d2f1-02bc-44fe-95b4-fb8ee453cb2b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.398044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab231-5943-4acc-8434-935457d5570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.398746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab231-5943-4acc-8434-935457d5570f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.399051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab231-5943-4acc-8434-935457d5570f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.399557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab231-5943-4acc-8434-935457d5570f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.400553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab231-5943-4acc-8434-935457d5570f None admin] RBAC: Adding query filter params (role.id=348e984331e04238983705ce2056932d, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=10e49e34bbf14bcf937c04f3475ffd77) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:28.400878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab231-5943-4acc-8434-935457d5570f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.402429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab231-5943-4acc-8434-935457d5570f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.408789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 62/121] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/role_assignments?user.id=10e49e34bbf14bcf937c04f3475ffd77&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=348e984331e04238983705ce2056932d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:28.409422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab231-5943-4acc-8434-935457d5570f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.493752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:28.505477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5d2f1-02bc-44fe-95b4-fb8ee453cb2b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.553810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdeefaa-97ea-46c1-a111-13efcfbc3385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.554577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab231-5943-4acc-8434-935457d5570f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.555477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeefaa-97ea-46c1-a111-13efcfbc3385 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.556469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeefaa-97ea-46c1-a111-13efcfbc3385 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.556957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeefaa-97ea-46c1-a111-13efcfbc3385 None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.558531 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdeefaa-97ea-46c1-a111-13efcfbc3385 None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.560543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdeefaa-97ea-46c1-a111-13efcfbc3385 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.562686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 60/122] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:28.564403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15cd7-80f9-403b-a2b7-a228a853d37f None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.564897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15cd7-80f9-403b-a2b7-a228a853d37f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.565576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15cd7-80f9-403b-a2b7-a228a853d37f None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.567266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 61/123] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:28.568246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15cd7-80f9-403b-a2b7-a228a853d37f None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.581699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:28.599721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.600303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.600596 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.600887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/c6476155f7c9405fac6f2d48d97cbd58/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.603527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] RBAC: Authorizing `identity:create_grant(project_id=3dfffa2803c648149b519f9bf3f4e3fd, user_id=c6476155f7c9405fac6f2d48d97cbd58, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.605035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.702425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 63/124] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:28 2022] PUT /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/c6476155f7c9405fac6f2d48d97cbd58/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:28.703077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:28.796188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15cd7-80f9-403b-a2b7-a228a853d37f None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.877602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426be1c-5e18-49b7-bc6c-0ff276e87bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.878994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426be1c-5e18-49b7-bc6c-0ff276e87bf2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.878994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426be1c-5e18-49b7-bc6c-0ff276e87bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.879283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426be1c-5e18-49b7-bc6c-0ff276e87bf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.882231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559931-290a-4586-8bda-cfcbe3d33037 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:28.895263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426be1c-5e18-49b7-bc6c-0ff276e87bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:28.898612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-f426be1c-5e18-49b7-bc6c-0ff276e87bf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:28.902884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:28.903772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:28.904616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:28.909105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 62/125] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:28.911116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66b3a-80e3-4561-b415-c85b57b57ee0 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.911521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66b3a-80e3-4561-b415-c85b57b57ee0 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.911950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66b3a-80e3-4561-b415-c85b57b57ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.935547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:28.936775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:28.937505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:28.938127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:28.939514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:28.941278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:28.942000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-55b66b3a-80e3-4561-b415-c85b57b57ee0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:28.943288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-55b66b3a-80e3-4561-b415-c85b57b57ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:28.943561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 64/126] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:28.944571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.062399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:29.069492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e674fd-11c8-4a0c-90c7-34e2887c78e3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:29.077912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 63/127] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:29.078704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b66b3a-80e3-4561-b415-c85b57b57ee0 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.124117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:29.125270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:29.126590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:29.127185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:29.128227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:29.128747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:29.130503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:29.145877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 65/128] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:29.147209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.201358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:29.264052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfba01f-206b-49ee-a62a-e781846a9ae1 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:29.304443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b66b3a-80e3-4561-b415-c85b57b57ee0 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:29.315066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:29.315961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:29.316518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:29.316934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:29.336374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:29.346475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:29.347664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:29.348510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:29.350385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 66/129] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:29.351767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.378765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:29.379468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:29.379756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:29.380039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/70961e1242bf4fa29c96ec8ec07acb33/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:29.386817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] RBAC: Authorizing `identity:create_grant(project_id=3dfffa2803c648149b519f9bf3f4e3fd, user_id=70961e1242bf4fa29c96ec8ec07acb33, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:29.388294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:29.458387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb549-221f-4c92-9d3a-4b56b8b45a9c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:29.460151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:29.493961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:29.494865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:29.495297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:29.495709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:29.497224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:29.498953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:29.500776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 67/130] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:29 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:29.501762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.547739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 64/131] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:29 2022] PUT /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/70961e1242bf4fa29c96ec8ec07acb33/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:29.548669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.613658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa203171-947b-4bff-b3c1-09916d1d1cd4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:29.653144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:29.654073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:29.654503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:29.655079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:29.655826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:29.657357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:29.657867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:29.659462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:29.669331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 68/132] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:29.679683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.751724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:29.778691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed73b6-a5da-43ea-880f-d3ca93131d9c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:29.853836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece83d1-28a2-4670-b8f9-5e33ecc5afc6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:29.856023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:29.856952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:29.857309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:29.857688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:29.862253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:29.863915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:29.865666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 65/133] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:29 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:29.871894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:29.908085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:29.910818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:29.911299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:29.912058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:29.914691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:29.917381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:29.919273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 69/134] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:29 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:29.924906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:30.069282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21686ec-7924-4d55-acaf-08b2de53ca74 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:30.083673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:30.088027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39bb2-ad35-46d0-8a06-7f7ce0f4781d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:30.111245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:30.124098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:30.125002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:30.125329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba88f7-ca81-4c18-b9a1-302db0f35238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:30.125720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:30.126047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba88f7-ca81-4c18-b9a1-302db0f35238 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:30.126357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba88f7-ca81-4c18-b9a1-302db0f35238 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:30.126547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] PATH_INFO: `/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:30.126649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba88f7-ca81-4c18-b9a1-302db0f35238 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/70961e1242bf4fa29c96ec8ec07acb33/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:30.128029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] RBAC: Authorizing `identity:get_project(project_id=6fc2e7a6f09648ddbff9be53787eb31a)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:30.129805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:30.131983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 70/135] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:29 2022] GET /identity/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:30.135634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba88f7-ca81-4c18-b9a1-302db0f35238 None admin] RBAC: Authorizing `identity:create_grant(project_id=3dfffa2803c648149b519f9bf3f4e3fd, user_id=70961e1242bf4fa29c96ec8ec07acb33, role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:30.137391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba88f7-ca81-4c18-b9a1-302db0f35238 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:30.138493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:30.223646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 66/136] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:29 2022] PUT /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/70961e1242bf4fa29c96ec8ec07acb33/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:35:30.226833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff5b38-613d-4e79-9b96-ee35942fd0b3 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:30.232621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff5b38-613d-4e79-9b96-ee35942fd0b3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:30.232621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff5b38-613d-4e79-9b96-ee35942fd0b3 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:30.232621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 67/137] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:30.244702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964c2-d073-418f-879d-4da4e54b9bec None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:30.245054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964c2-d073-418f-879d-4da4e54b9bec None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:30.245339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964c2-d073-418f-879d-4da4e54b9bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:30.279443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-5e2964c2-d073-418f-879d-4da4e54b9bec None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:30.280701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5e2964c2-d073-418f-879d-4da4e54b9bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:30.299077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cba9d-2ef2-4992-9ac7-46bca1844026 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:30.338480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:30.339186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:30.339531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:30.339823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] PATH_INFO: `/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a/users/70961e1242bf4fa29c96ec8ec07acb33/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:30.343058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] RBAC: Authorizing `identity:create_grant(project_id=6fc2e7a6f09648ddbff9be53787eb31a, user_id=70961e1242bf4fa29c96ec8ec07acb33, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:30.344544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:30.399093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 68/138] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 01 15:35:30.423496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2964c2-d073-418f-879d-4da4e54b9bec None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:30.434610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 71/139] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:30 2022] PUT /identity/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a/users/70961e1242bf4fa29c96ec8ec07acb33/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:30.561603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2964c2-d073-418f-879d-4da4e54b9bec None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:30.585243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:30.604620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b84c2-ca76-4083-94fe-059baf4b6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:30.605280 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b84c2-ca76-4083-94fe-059baf4b6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:30.605585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b84c2-ca76-4083-94fe-059baf4b6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:30.605868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b84c2-ca76-4083-94fe-059baf4b6ca7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:30.607029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b84c2-ca76-4083-94fe-059baf4b6ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:30.608504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b84c2-ca76-4083-94fe-059baf4b6ca7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:30.610423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 69/140] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:30.616111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:30.670350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:30.766184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577e24c-22ed-4a5c-9e2e-1c68838da6df None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:30.801425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d1698-6f07-45ba-88cf-4e2b9c788470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:30.802132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1698-6f07-45ba-88cf-4e2b9c788470 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:30.802424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1698-6f07-45ba-88cf-4e2b9c788470 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:30.802710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1698-6f07-45ba-88cf-4e2b9c788470 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:30.803408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d1698-6f07-45ba-88cf-4e2b9c788470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:30.804876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d1698-6f07-45ba-88cf-4e2b9c788470 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:30.938984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 72/141] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:35:30 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:31.395567 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ee4ea-fda9-4ba2-8564-8d521b4fc87d None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.396097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ee4ea-fda9-4ba2-8564-8d521b4fc87d None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.396097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ee4ea-fda9-4ba2-8564-8d521b4fc87d None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.397481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 70/142] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:31.399839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848272ac-8497-4abe-bec5-3ea7e86ab631 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.400251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848272ac-8497-4abe-bec5-3ea7e86ab631 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.400629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848272ac-8497-4abe-bec5-3ea7e86ab631 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.402260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 73/143] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:31.404512 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda6ec-01a5-4553-a873-23e15899899c None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.404734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda6ec-01a5-4553-a873-23e15899899c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.405016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda6ec-01a5-4553-a873-23e15899899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.415433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb059-edc0-4788-9cb1-a9545cca631a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.415726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb059-edc0-4788-9cb1-a9545cca631a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.416006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb059-edc0-4788-9cb1-a9545cca631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.442140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4dcda6ec-01a5-4553-a873-23e15899899c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:31.443331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4dcda6ec-01a5-4553-a873-23e15899899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:31.452107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c27fb059-edc0-4788-9cb1-a9545cca631a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:31.453282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c27fb059-edc0-4788-9cb1-a9545cca631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:31.563591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 74/144] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:31.566769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 71/145] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:31.591866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fb059-edc0-4788-9cb1-a9545cca631a None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:31.597464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda6ec-01a5-4553-a873-23e15899899c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:31.618693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:31.734651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fb059-edc0-4788-9cb1-a9545cca631a None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:31.773074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:31.773415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda6ec-01a5-4553-a873-23e15899899c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:31.774832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.775311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.775763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.788009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:31.793467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:31.794328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:31.795090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:31.797460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 75/146] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:31.801913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:31.803412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:31.827303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:31.827884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.828166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.828442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.850952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:31.856037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:31.856867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:31.858085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 72/147] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:31.864296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:31.891403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:31.917692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e600-bd65-4fa0-9a78-10a97def86b3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:31.970504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:31.971148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:31.971437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:31.972307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:31.972463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:31.972902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:31.974366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:32.001561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 76/148] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:32.006316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:32.029495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c97089-62db-4276-ad53-aa3828ba1fe4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:32.094584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:32.095139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.095421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.095696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.101609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:32.101609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:32.102641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:32.118967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 73/149] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:32.123218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:32.158519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeed61-0681-4eb5-a1ea-f6302de729b3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:32.184917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:32.243832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:32.244777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.245063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.245339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] PATH_INFO: `/v3/users/c6476155f7c9405fac6f2d48d97cbd58` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.251050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] RBAC: Authorizing `identity:get_user(user_id=c6476155f7c9405fac6f2d48d97cbd58)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:32.254797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:32.256452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 77/150] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:32 2022] GET /identity/v3/users/c6476155f7c9405fac6f2d48d97cbd58 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:32.263113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:32.273350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:32.338792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9019-a0a6-4b64-81ff-2223e4b9c8fa None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:32.392116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c76c1c-fdb0-4b7f-b99d-13c837c60074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:32.392706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76c1c-fdb0-4b7f-b99d-13c837c60074 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.392992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76c1c-fdb0-4b7f-b99d-13c837c60074 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.393254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76c1c-fdb0-4b7f-b99d-13c837c60074 None admin] PATH_INFO: `/v3/users/10e49e34bbf14bcf937c04f3475ffd77` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.397295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c76c1c-fdb0-4b7f-b99d-13c837c60074 None admin] RBAC: Authorizing `identity:get_user(user_id=10e49e34bbf14bcf937c04f3475ffd77)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:32.398791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c76c1c-fdb0-4b7f-b99d-13c837c60074 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:32.400792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 74/151] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:32 2022] GET /identity/v3/users/10e49e34bbf14bcf937c04f3475ffd77 => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:32.405788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba2ab-a546-4878-a313-4958f4f113fd None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.406077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba2ab-a546-4878-a313-4958f4f113fd None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.406352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaba2ab-a546-4878-a313-4958f4f113fd None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.407883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 75/152] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:32.409378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba2ab-a546-4878-a313-4958f4f113fd None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:32.464397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ff61e-fec1-444e-9e70-85565b492979 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:32.516637 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaba2ab-a546-4878-a313-4958f4f113fd None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:32.519358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:32.526276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:32.526926 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.527211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.527489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.552681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6bb6-816f-4a50-8ebb-1e39675f2c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:32.553334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6bb6-816f-4a50-8ebb-1e39675f2c28 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.553659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6bb6-816f-4a50-8ebb-1e39675f2c28 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.553960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6bb6-816f-4a50-8ebb-1e39675f2c28 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.555128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6bb6-816f-4a50-8ebb-1e39675f2c28 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:32.557208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6bb6-816f-4a50-8ebb-1e39675f2c28 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:32.559474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 76/153] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:32 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:32.560641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab93d-88af-4c20-aae9-e6979e581731 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.560970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab93d-88af-4c20-aae9-e6979e581731 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.561198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab93d-88af-4c20-aae9-e6979e581731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.584257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a4fab93d-88af-4c20-aae9-e6979e581731 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:32.585501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a4fab93d-88af-4c20-aae9-e6979e581731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:32.649793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:32.651375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:32.657352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 77/154] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:32.658233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab93d-88af-4c20-aae9-e6979e581731 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:32.658411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:32.761784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab93d-88af-4c20-aae9-e6979e581731 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:32.763345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:32.799287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:32.799969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:32.800254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:32.800527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/10e49e34bbf14bcf937c04f3475ffd77/roles/348e984331e04238983705ce2056932d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:32.802502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] RBAC: Authorizing `identity:create_grant(project_id=3dfffa2803c648149b519f9bf3f4e3fd, user_id=10e49e34bbf14bcf937c04f3475ffd77, role_id=348e984331e04238983705ce2056932d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:32.803974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:32.822643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 78/155] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:32.823567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:32.871626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 78/156] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:32 2022] PUT /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/users/10e49e34bbf14bcf937c04f3475ffd77/roles/348e984331e04238983705ce2056932d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:32.872242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:33.021678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351926c7-7770-46f9-a752-f4d0111fb8a5 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:33.030578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:33.067424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7e6c-637d-4723-ae57-f1c4f05c05dc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:33.094548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:33.095203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.095487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.095762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.118309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:33.118973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.119258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.119539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.120665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:33.120784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:33.122249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:33.123932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 79/157] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:32 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:33.125840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:33.126729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:33.127508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 79/158] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:33.130406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:33.134421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:33.164281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:33.241432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b7aa2-5bb2-45b0-81d7-a5714a6c9867 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:33.283261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:33.283978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.284273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.284551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.285364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=c6476155f7c9405fac6f2d48d97cbd58) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:33.285710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:33.287188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:33.297802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 80/159] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:33 2022] GET /identity/v3/role_assignments?user.id=c6476155f7c9405fac6f2d48d97cbd58&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:33.373110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaad17-311d-464c-ac6c-edca3a786413 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:33.412926 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcbdb3-befe-4300-973d-aaa525c49b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:33.413602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcbdb3-befe-4300-973d-aaa525c49b1e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.413892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcbdb3-befe-4300-973d-aaa525c49b1e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.414173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcbdb3-befe-4300-973d-aaa525c49b1e None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.414916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcbdb3-befe-4300-973d-aaa525c49b1e None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:33.415223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcbdb3-befe-4300-973d-aaa525c49b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:33.416655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcbdb3-befe-4300-973d-aaa525c49b1e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:33.425870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 80/160] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:33.431313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:33.560385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:33.568600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44a88-4f0c-4f59-b923-dcbdd88e47e8 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:33.576100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f766e5-b156-4acb-b070-d98361fa21b9 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.576570 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f766e5-b156-4acb-b070-d98361fa21b9 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.579938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f766e5-b156-4acb-b070-d98361fa21b9 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.579938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 81/161] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:33.583512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffaa90-cf9b-46b1-8097-ec2351f7b499 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.583808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffaa90-cf9b-46b1-8097-ec2351f7b499 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.584162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffaa90-cf9b-46b1-8097-ec2351f7b499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.604819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-fcffaa90-cf9b-46b1-8097-ec2351f7b499 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:33.609044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-fcffaa90-cf9b-46b1-8097-ec2351f7b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:33.613310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:33.614446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.615097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.615578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.617067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:33.619850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:33.622474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 81/162] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:33 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:33.628499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:33.646340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:33.748023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 82/163] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:33.782715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffaa90-cf9b-46b1-8097-ec2351f7b499 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:33.800593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d5007-a388-4159-836a-70805c73f5ef None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:33.847512 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:33.848069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:33.848352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:33.848626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:33.938195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:33.986460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffaa90-cf9b-46b1-8097-ec2351f7b499 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:33.988767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:33.991182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:34.042237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:34.043288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.043927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.044410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.066236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:34.071709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:34.072589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:34.073357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:34.076141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 83/164] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:34.087866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:34.117375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:34.197948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 82/165] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:34.204194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:34.270871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e172c6b-16c8-4500-a066-8a14a53eb26c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:34.331994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:34.332698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.332988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.333267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.334093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:34.334408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:34.335817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:34.349141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 84/166] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:34.355227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:34.409964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:34.470169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:34.497930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900fde7-f9fe-46cd-b342-bcaf256c1341 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:34.546351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:34.547165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.547457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.547736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.548928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:34.549369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c3210-073b-45f6-850d-c67db1d99398 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:34.550480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:34.557918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 85/167] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:34 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:34.559056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:34.623778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:34.624466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.624744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.625027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.626270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:34.627746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:34.629639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 83/168] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:34 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:34.638370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:34.710452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37663fbb-cc4c-45e2-a350-e633719ee1ef None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:34.762290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:34.762932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.763218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.763499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.790328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:34.858662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:34.860552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:34.890051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896243-2d8c-433d-8466-c8ff0ed0ec43 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:34.965965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:34.976804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f88bf-6148-436e-9ea9-e537b4777249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:34.983146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f88bf-6148-436e-9ea9-e537b4777249 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:34.983851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f88bf-6148-436e-9ea9-e537b4777249 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:34.985239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f88bf-6148-436e-9ea9-e537b4777249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:34.986271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f88bf-6148-436e-9ea9-e537b4777249 None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=70961e1242bf4fa29c96ec8ec07acb33) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:34.986910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f88bf-6148-436e-9ea9-e537b4777249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:34.989701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f88bf-6148-436e-9ea9-e537b4777249 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:35.005084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 84/169] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:34 2022] GET /identity/v3/role_assignments?user.id=70961e1242bf4fa29c96ec8ec07acb33&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=da9b6fc593c747e48d031adf8b20978d => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:35.008841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75556e-2080-44a6-88e4-7ccf1eef5a57 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.009362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75556e-2080-44a6-88e4-7ccf1eef5a57 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.011091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75556e-2080-44a6-88e4-7ccf1eef5a57 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.021406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 85/170] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:35.038307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f07625-0c9f-4ac8-b35c-3d0f96d71863 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.038870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f07625-0c9f-4ac8-b35c-3d0f96d71863 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.039344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f07625-0c9f-4ac8-b35c-3d0f96d71863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.066978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d4f07625-0c9f-4ac8-b35c-3d0f96d71863 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:35.069233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d4f07625-0c9f-4ac8-b35c-3d0f96d71863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:35.075197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 86/171] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:35.080598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:35.187781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:35.229994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 86/172] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:35.269536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f07625-0c9f-4ac8-b35c-3d0f96d71863 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:35.280772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7d08-741c-4705-937f-0e6e7cac3cd0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:35.375716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:35.376648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.377071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.377487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.382275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:35.383805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:35.385581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 87/173] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:35 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:35.391494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:35.405388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f07625-0c9f-4ac8-b35c-3d0f96d71863 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:35.456335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:35.487664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:35.488255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.488544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.488821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.522474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:35.528132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:35.529019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:35.530231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 87/174] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:35.538073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:35.542674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45219-60d7-468d-a04e-3d2a85c7139d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:35.563263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:35.591956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86beb2a-6d31-45b1-90dd-4c8822581e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:35.592947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86beb2a-6d31-45b1-90dd-4c8822581e1c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.593605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86beb2a-6d31-45b1-90dd-4c8822581e1c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.594087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86beb2a-6d31-45b1-90dd-4c8822581e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.595363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86beb2a-6d31-45b1-90dd-4c8822581e1c None admin] RBAC: Adding query filter params (role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=70961e1242bf4fa29c96ec8ec07acb33) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:35.595896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86beb2a-6d31-45b1-90dd-4c8822581e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:35.598591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86beb2a-6d31-45b1-90dd-4c8822581e1c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:35.606596 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 88/175] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:35 2022] GET /identity/v3/role_assignments?user.id=70961e1242bf4fa29c96ec8ec07acb33&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:35.691014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a9229-54ef-46dc-bc9d-20ddac9bb7d4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:35.707480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e8e1-8066-4276-81ea-df50bce69832 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.708134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e8e1-8066-4276-81ea-df50bce69832 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.708618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e8e1-8066-4276-81ea-df50bce69832 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.710422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 89/176] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:35.723125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faab3-1afb-4ca9-9de5-5fd7ccf78b46 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.724230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faab3-1afb-4ca9-9de5-5fd7ccf78b46 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.724714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faab3-1afb-4ca9-9de5-5fd7ccf78b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.755645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-748faab3-1afb-4ca9-9de5-5fd7ccf78b46 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:35.757529 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-748faab3-1afb-4ca9-9de5-5fd7ccf78b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:35.767848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:35.768838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.769349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.769851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:35.770857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] RBAC: Adding query filter params (name=member) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:35.771363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:35.773337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:35.797639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 88/177] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:35.802601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:35.891470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 90/178] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:35.894617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:35.931219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748faab3-1afb-4ca9-9de5-5fd7ccf78b46 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:35.950479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f90d-1daf-4c48-bd53-60f60721b050 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:35.997614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4751ac-1983-4d9f-afea-8eb046d503c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:35.998270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4751ac-1983-4d9f-afea-8eb046d503c9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:35.998557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4751ac-1983-4d9f-afea-8eb046d503c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:35.998840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4751ac-1983-4d9f-afea-8eb046d503c9 None admin] PATH_INFO: `/v3/users/70961e1242bf4fa29c96ec8ec07acb33` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.000036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4751ac-1983-4d9f-afea-8eb046d503c9 None admin] RBAC: Authorizing `identity:get_user(user_id=70961e1242bf4fa29c96ec8ec07acb33)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:36.001492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4751ac-1983-4d9f-afea-8eb046d503c9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:36.003154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 89/179] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:35 2022] GET /identity/v3/users/70961e1242bf4fa29c96ec8ec07acb33 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:36.004366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300402f2-bd63-4191-8c1d-1c43b33d689c None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.004658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300402f2-bd63-4191-8c1d-1c43b33d689c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.004936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300402f2-bd63-4191-8c1d-1c43b33d689c None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.006579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 90/180] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:36.010271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300402f2-bd63-4191-8c1d-1c43b33d689c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:36.057278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748faab3-1afb-4ca9-9de5-5fd7ccf78b46 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:36.072168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:36.107210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87906da2-9bce-489c-a4a6-21d07749b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:36.107866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906da2-9bce-489c-a4a6-21d07749b19b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.108150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906da2-9bce-489c-a4a6-21d07749b19b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.108424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906da2-9bce-489c-a4a6-21d07749b19b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.109700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87906da2-9bce-489c-a4a6-21d07749b19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:36.111277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87906da2-9bce-489c-a4a6-21d07749b19b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:36.113577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 91/181] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:36.114779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cac5-bb89-4f50-a017-52d562e1d43e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.115069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cac5-bb89-4f50-a017-52d562e1d43e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.115416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cac5-bb89-4f50-a017-52d562e1d43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.136658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3c47cac5-bb89-4f50-a017-52d562e1d43e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:36.137982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3c47cac5-bb89-4f50-a017-52d562e1d43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:36.147211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300402f2-bd63-4191-8c1d-1c43b33d689c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:36.165571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:36.191682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:36.192742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.193079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.193659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.220880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 92/182] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:36.221856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47cac5-bb89-4f50-a017-52d562e1d43e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:36.303503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:36.305881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:36.356449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47cac5-bb89-4f50-a017-52d562e1d43e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:36.363823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:36.391270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0011148-3a9c-4369-a7d1-cd987c289e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:36.391894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011148-3a9c-4369-a7d1-cd987c289e96 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.392502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011148-3a9c-4369-a7d1-cd987c289e96 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.392811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011148-3a9c-4369-a7d1-cd987c289e96 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.393831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0011148-3a9c-4369-a7d1-cd987c289e96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:36.395478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0011148-3a9c-4369-a7d1-cd987c289e96 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:36.419283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 91/183] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:36.419283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:36.433101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:36.513699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633a1e-83d2-4e9c-9487-9afaecf47521 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:36.528832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 93/184] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:35:36 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:36.543408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2a5fe-136f-4929-b766-dea2f67a83ef None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.543642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2a5fe-136f-4929-b766-dea2f67a83ef None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.543927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2a5fe-136f-4929-b766-dea2f67a83ef None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.545414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 94/185] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:36.546107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2a5fe-136f-4929-b766-dea2f67a83ef None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:36.547448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91252e-4d6a-4e0d-a59f-761016faa9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:36.548134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91252e-4d6a-4e0d-a59f-761016faa9eb None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.548415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91252e-4d6a-4e0d-a59f-761016faa9eb None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.548682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91252e-4d6a-4e0d-a59f-761016faa9eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.562962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91252e-4d6a-4e0d-a59f-761016faa9eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-4d91252e-4d6a-4e0d-a59f-761016faa9eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:36.568229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:36.569206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:36.570028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 92/186] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:36.570981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14843-1439-4f8a-b8f0-514f27fa52e9 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.571526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14843-1439-4f8a-b8f0-514f27fa52e9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.571526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14843-1439-4f8a-b8f0-514f27fa52e9 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.572873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 93/187] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:36.578315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2b2d-0244-4309-bcba-54dad4230de3 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.578608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2b2d-0244-4309-bcba-54dad4230de3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.578890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2b2d-0244-4309-bcba-54dad4230de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.598230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f06b2b2d-0244-4309-bcba-54dad4230de3 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:36.599478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f06b2b2d-0244-4309-bcba-54dad4230de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:36.673696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2a5fe-136f-4929-b766-dea2f67a83ef None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:36.685549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 94/188] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:36.685549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2b2d-0244-4309-bcba-54dad4230de3 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:36.687243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:36.729511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabebd86-b969-48ff-9eba-4ad973ccc9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:36.730899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabebd86-b969-48ff-9eba-4ad973ccc9ca None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.731006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabebd86-b969-48ff-9eba-4ad973ccc9ca None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.731228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabebd86-b969-48ff-9eba-4ad973ccc9ca None admin] PATH_INFO: `/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.733616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabebd86-b969-48ff-9eba-4ad973ccc9ca None admin] RBAC: Authorizing `identity:get_project(project_id=6fc2e7a6f09648ddbff9be53787eb31a)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:36.738025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabebd86-b969-48ff-9eba-4ad973ccc9ca None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:36.738025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 95/189] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:36 2022] GET /identity/v3/projects/6fc2e7a6f09648ddbff9be53787eb31a => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:36.738865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00487d-25d4-4d31-8f3b-95cbd25ce83f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.739200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00487d-25d4-4d31-8f3b-95cbd25ce83f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.739478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00487d-25d4-4d31-8f3b-95cbd25ce83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.759717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-af00487d-25d4-4d31-8f3b-95cbd25ce83f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:36.760906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-af00487d-25d4-4d31-8f3b-95cbd25ce83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:36.787945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:36.805222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2b2d-0244-4309-bcba-54dad4230de3 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:36.846452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 96/190] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:36.847873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00487d-25d4-4d31-8f3b-95cbd25ce83f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:36.848024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:36.848552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:36.848840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:36.849123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:36.849979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:36.850289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:36.853407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:36.862890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 95/191] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:36.864039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:36.956022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:36.979154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00487d-25d4-4d31-8f3b-95cbd25ce83f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.001417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c82d-2d19-492c-843e-280a127b0752 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.019506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.020196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.020975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.021262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.035893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:37.042325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:37.043733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:37.045997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:37.048109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 97/192] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:37.049060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.050004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.050845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.051307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.051759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.052751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=6fc2e7a6f09648ddbff9be53787eb31a, user.id=70961e1242bf4fa29c96ec8ec07acb33) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:37.053291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.055001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.062803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 96/193] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:36 2022] GET /identity/v3/role_assignments?user.id=70961e1242bf4fa29c96ec8ec07acb33&scope.project.id=6fc2e7a6f09648ddbff9be53787eb31a&role.id=da9b6fc593c747e48d031adf8b20978d => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:37.071268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.074745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:37.159797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846244-ae02-4bbe-86a8-59d2e5b3ba68 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.215737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.216397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.216676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.216948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] PATH_INFO: `/v3/users/41b17042ea674831a017054dff031983` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.242332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] RBAC: Authorizing `identity:get_user(user_id=41b17042ea674831a017054dff031983)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.244466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.246410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 98/194] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/users/41b17042ea674831a017054dff031983 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:37.247005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.271606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8897d2-3cd1-4559-bad5-c93f062c0f70 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.315246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:37.321378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.322065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.322346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.322619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.335657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:37.340856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:37.341883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:37.342702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 97/195] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:37.343345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.380924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:37.417160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4298fc-fcf6-4218-adc0-ee32b59eb87d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.471164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.471799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.472369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.472678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.474993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:37.475325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.475536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f729c-3de8-46e2-972c-551b7c71f2bb None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.477424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.490708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 99/196] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:37.494020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.535245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.536349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.536918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.537366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.611841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:37.613330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b50b6-69c0-4727-9ab7-a376a8cf8806 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.622668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.624223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.647973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.649468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.649955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.650404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.651291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] RBAC: Adding query filter params (name=reader) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:37.651794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.653424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.662272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 100/197] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:37.663396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.685858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:37.733394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 98/198] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:37.734221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.765402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea6d9-f89e-4619-8b6c-b6233f2de80c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.800269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.801239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.801973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.802445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] PATH_INFO: `/v3/users/41b17042ea674831a017054dff031983` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.803833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] RBAC: Authorizing `identity:get_user(user_id=41b17042ea674831a017054dff031983)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.807759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.810023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 101/199] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/users/41b17042ea674831a017054dff031983 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:37.815416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.829091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:37.839467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e341-962e-484e-8e0c-41055ab3fd5c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.881404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.882397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.882873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.883969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] PATH_INFO: `/v3/users/10e49e34bbf14bcf937c04f3475ffd77` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.885629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] RBAC: Authorizing `identity:get_user(user_id=10e49e34bbf14bcf937c04f3475ffd77)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.887484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.889711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 99/200] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/users/10e49e34bbf14bcf937c04f3475ffd77 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:37.890709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:37.895928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:37.932095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d190e1f-3714-4995-be0a-a3c64164e715 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:37.968170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:37.968521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:37.968812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:37.969095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:37.970739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:37.972213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:37.974106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 102/201] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:37.974725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:38.005658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe0768-9954-461e-a3eb-cc9f8c98333b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.041979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.042962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.043454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.043964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.073734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:38.081369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec42a-c1fc-423d-b8de-64a698b73d85 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.115387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.116016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.116335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.116574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.118205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.119898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.137956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:38.189964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.191819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.236785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 100/202] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:38.237969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:38.314935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:38.315116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 103/203] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:38.315116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:38.357734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aac01-9f39-4562-8483-b8a0cdf7559e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.364897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:38.401640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.401640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.401640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.401640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.402010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=41b17042ea674831a017054dff031983) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:38.402010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.402456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.409474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 101/204] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:38 2022] GET /identity/v3/role_assignments?user.id=41b17042ea674831a017054dff031983&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:38.411036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:38.457325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f734a-bb80-408e-9103-97b467b7b931 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.515052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.515732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.516018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.516320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.518280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.519788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.521931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 104/205] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:38 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:38.528557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:38.612367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665a81-2ee1-4e49-9080-1f313f1b2cce None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.673083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:38.702687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651d16-832d-480e-90eb-ba98f78687f9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.706253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.706929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.707270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.707554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.708802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.710344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.719172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:38.721129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 102/206] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:38 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:38.733839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:38.755819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13754992-b8d8-4493-869d-4f9f5a10a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.756831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754992-b8d8-4493-869d-4f9f5a10a36b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.758749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754992-b8d8-4493-869d-4f9f5a10a36b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.759337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754992-b8d8-4493-869d-4f9f5a10a36b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.760335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13754992-b8d8-4493-869d-4f9f5a10a36b None admin] RBAC: Adding query filter params (role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=41b17042ea674831a017054dff031983) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:38.761038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13754992-b8d8-4493-869d-4f9f5a10a36b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.763641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13754992-b8d8-4493-869d-4f9f5a10a36b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.776758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 105/207] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:38 2022] GET /identity/v3/role_assignments?user.id=41b17042ea674831a017054dff031983&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:38.883063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653153a-a666-4ea8-b5fb-3325ff895547 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:38.905157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f465-000c-44ac-a467-aa105a12016b None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.905465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f465-000c-44ac-a467-aa105a12016b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.905792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f465-000c-44ac-a467-aa105a12016b None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.907294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 106/208] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:38.912451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d2ef-0884-4e4d-9a5e-9b418df6962b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.913015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d2ef-0884-4e4d-9a5e-9b418df6962b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.913488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d2ef-0884-4e4d-9a5e-9b418df6962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.942568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e8c1d2ef-0884-4e4d-9a5e-9b418df6962b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:38.944780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e8c1d2ef-0884-4e4d-9a5e-9b418df6962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:38.945408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a38b2-d68b-4b75-8f02-f286c83efc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:38.946108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a38b2-d68b-4b75-8f02-f286c83efc2f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.946394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a38b2-d68b-4b75-8f02-f286c83efc2f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.946674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a38b2-d68b-4b75-8f02-f286c83efc2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.947484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a38b2-d68b-4b75-8f02-f286c83efc2f None admin] RBAC: Adding query filter params (role.id=348e984331e04238983705ce2056932d, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd, user.id=10e49e34bbf14bcf937c04f3475ffd77) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:38.947804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a38b2-d68b-4b75-8f02-f286c83efc2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:38.949301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a38b2-d68b-4b75-8f02-f286c83efc2f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:38.956345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 103/209] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:38 2022] GET /identity/v3/role_assignments?user.id=10e49e34bbf14bcf937c04f3475ffd77&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=348e984331e04238983705ce2056932d => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:38.961574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef46c-c7fb-4900-9ffe-cfdacb0c2d72 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.961574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef46c-c7fb-4900-9ffe-cfdacb0c2d72 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.961574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef46c-c7fb-4900-9ffe-cfdacb0c2d72 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.961574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 104/210] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:38.966085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09de5-4017-4244-91db-8bad4d4886b3 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:38.966388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09de5-4017-4244-91db-8bad4d4886b3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:38.966681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09de5-4017-4244-91db-8bad4d4886b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:38.986406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d7c09de5-4017-4244-91db-8bad4d4886b3 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:38.987673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d7c09de5-4017-4244-91db-8bad4d4886b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:39.044004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:39.060625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 107/211] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:39.063888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 105/212] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:39.093354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1d2ef-0884-4e4d-9a5e-9b418df6962b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:39.097030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c09de5-4017-4244-91db-8bad4d4886b3 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:39.226282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c09de5-4017-4244-91db-8bad4d4886b3 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:39.279396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:39.280066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:39.280354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:39.280631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:39.282355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:39.286853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1d2ef-0884-4e4d-9a5e-9b418df6962b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:39.298377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:39.303511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:39.304450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:39.305907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 106/213] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:39.312561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:39.340703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:39.341774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:39.342277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:39.342746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:39.344101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:39.345789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:39.347937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 108/214] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:39.354971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:39.376387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:39.447293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e43d-2048-4684-bf45-62f3a6974b8c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:39.484783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:39.485796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:39.486279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:39.486749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:39.487661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] RBAC: Adding query filter params (name=member) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:39.488162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:39.489847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:39.499031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68721-a14b-4696-bdd5-1cc39be4ffb4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:39.499917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 107/215] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:39.506708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:39.546649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:39.547667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:39.547964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:39.548239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:39.549210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:39.550771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:39.626368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f084ec-bbc9-4134-9bb8-1a05c8991bcc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:39.634253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:39.662662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:39.663362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:39.663739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:39.664034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] PATH_INFO: `/v3/users/dab1704870634b9e8da1066511314cfe` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:39.680302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] RBAC: Authorizing `identity:get_user(user_id=dab1704870634b9e8da1066511314cfe)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:39.681849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:39.688476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 108/216] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:39 2022] GET /identity/v3/users/dab1704870634b9e8da1066511314cfe => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:39.689458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:39.693754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 109/217] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:35:39 2022] POST /identity/v3/users => generated 297 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:39.809325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b6ace-6e67-4ac2-a604-d24d367bf902 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:39.847107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:39.847742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:39.848026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:39.848305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:39.881750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:39.919661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:39.921150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:40.027008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 109/218] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:40.032896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:40.069583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:40.156052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8689e7-2e46-4019-ad56-fb31a708dd71 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:40.191463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ff68-4ea5-497a-b2ec-753ca3be257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:40.192119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ff68-4ea5-497a-b2ec-753ca3be257a None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.192405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ff68-4ea5-497a-b2ec-753ca3be257a None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.192685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ff68-4ea5-497a-b2ec-753ca3be257a None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.193959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4ff68-4ea5-497a-b2ec-753ca3be257a None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:40.195975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4ff68-4ea5-497a-b2ec-753ca3be257a None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:40.197992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 110/219] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:40 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:40.203429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:40.309621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:40.367765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e90dd-c4e2-4b51-a583-b0cfdcbf02c8 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:40.420528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f5edb-40b2-4944-970a-8f5f0ece97e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:40.421159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5edb-40b2-4944-970a-8f5f0ece97e7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.421445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5edb-40b2-4944-970a-8f5f0ece97e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.421752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5edb-40b2-4944-970a-8f5f0ece97e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.422551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5edb-40b2-4944-970a-8f5f0ece97e7 None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=dab1704870634b9e8da1066511314cfe) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:40.422862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5edb-40b2-4944-970a-8f5f0ece97e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:40.424331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5edb-40b2-4944-970a-8f5f0ece97e7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:40.435321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 110/220] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:40 2022] GET /identity/v3/role_assignments?user.id=dab1704870634b9e8da1066511314cfe&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=da9b6fc593c747e48d031adf8b20978d => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:40.608287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec24f1-a4f9-49b5-b68b-28eeaf85eb33 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.608287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec24f1-a4f9-49b5-b68b-28eeaf85eb33 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.608287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec24f1-a4f9-49b5-b68b-28eeaf85eb33 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.609054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 111/221] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:40.614987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4217-7767-4613-a59f-168718c187ed None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.615279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4217-7767-4613-a59f-168718c187ed None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.615565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4217-7767-4613-a59f-168718c187ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.643772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-386d4217-7767-4613-a59f-168718c187ed None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:40.644995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-386d4217-7767-4613-a59f-168718c187ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:40.783050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 111/222] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:40.816091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec24f1-a4f9-49b5-b68b-28eeaf85eb33 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:40.985955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:41.003202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec24f1-a4f9-49b5-b68b-28eeaf85eb33 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:41.059873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26667e-3dd7-4c8a-9e49-6f61d82fc688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:41.061361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26667e-3dd7-4c8a-9e49-6f61d82fc688 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.061875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26667e-3dd7-4c8a-9e49-6f61d82fc688 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.062373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26667e-3dd7-4c8a-9e49-6f61d82fc688 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.078155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26667e-3dd7-4c8a-9e49-6f61d82fc688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-ea26667e-3dd7-4c8a-9e49-6f61d82fc688 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:41.083595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:41.084448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:41.085232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:41.091832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 112/223] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:41.098668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4217-7767-4613-a59f-168718c187ed None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:41.207809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:41.239623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee8f3-b4e2-4430-be14-b104b4496c5f None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.239928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee8f3-b4e2-4430-be14-b104b4496c5f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.240095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee8f3-b4e2-4430-be14-b104b4496c5f None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.243790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 113/224] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:41.248332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7d3cb-d6f6-4657-9aec-e150d072d030 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.248626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7d3cb-d6f6-4657-9aec-e150d072d030 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.248913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7d3cb-d6f6-4657-9aec-e150d072d030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.269133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4217-7767-4613-a59f-168718c187ed None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:41.279415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1ec7d3cb-d6f6-4657-9aec-e150d072d030 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:41.280632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1ec7d3cb-d6f6-4657-9aec-e150d072d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:41.315435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:41.316408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.316940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.317410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.318346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:41.318843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:41.321038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:41.329944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 112/225] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:41.341542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:41.424921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 114/226] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:41.477462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7d3cb-d6f6-4657-9aec-e150d072d030 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:41.519782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddb080-2e3c-4727-9137-b23a733d205e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:41.569898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:41.587887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:41.588331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:41.589191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.589477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.589782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] PATH_INFO: `/v3/users/41b17042ea674831a017054dff031983` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.591601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] RBAC: Authorizing `identity:get_user(user_id=41b17042ea674831a017054dff031983)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:41.593341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:41.595719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 113/227] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:41 2022] GET /identity/v3/users/41b17042ea674831a017054dff031983 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:41.601396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:41.627360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7d3cb-d6f6-4657-9aec-e150d072d030 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:41.666698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:41.667403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.667689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.667998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.689728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:41.696320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:41.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:41.697982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:41.700760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 115/228] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:41.709085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:41.828493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b9e5-8711-4e98-9806-bdbe54aa62f3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:41.859698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d908b-c666-4a43-9b2b-7a1ba07d9f05 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:41.863156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:41.863786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.864072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.864349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.865076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:41.865379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:41.866860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:41.876225 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 116/229] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:41.881675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:41.885820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:41.923649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:41.924327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.924622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.924897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.930295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:41.931790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:41.934208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 114/230] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:41 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:41.946444 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:41.994213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0256d25-15c2-4474-b827-ed15e8c79df3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:42.016492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:42.030574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:42.031274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.031566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.031843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] PATH_INFO: `/v3/users/41b17042ea674831a017054dff031983` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.033099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] RBAC: Authorizing `identity:get_user(user_id=41b17042ea674831a017054dff031983)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:42.034753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:42.036708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 117/231] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:41 2022] GET /identity/v3/users/41b17042ea674831a017054dff031983 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:42.042972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:42.064997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e3228-21bf-47e6-ac54-494741f770fd None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:42.102592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:42.103370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.103758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.104538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44/users/41b17042ea674831a017054dff031983/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.111716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] RBAC: Authorizing `identity:create_grant(project_id=6511d05de70544bfb533be84d6340a44, user_id=41b17042ea674831a017054dff031983, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:42.113200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:42.153946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:42.163826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0555156-4bde-4bd7-901d-4310ef39b42c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:42.194273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 115/232] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:41 2022] PUT /identity/v3/projects/6511d05de70544bfb533be84d6340a44/users/41b17042ea674831a017054dff031983/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:42.206909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda445e-66e4-4117-8c99-308ca2101660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:42.207655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda445e-66e4-4117-8c99-308ca2101660 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.207946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda445e-66e4-4117-8c99-308ca2101660 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.208229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda445e-66e4-4117-8c99-308ca2101660 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.209618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda445e-66e4-4117-8c99-308ca2101660 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:42.211721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda445e-66e4-4117-8c99-308ca2101660 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:42.213799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 118/233] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:42 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:42.220142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:42.385096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edbc5e-c5a1-478c-80fe-19330834cb03 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:42.402503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:42.421881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:42.422570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.422899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.423185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44/users/41b17042ea674831a017054dff031983/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.425422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6511d05de70544bfb533be84d6340a44, user_id=41b17042ea674831a017054dff031983, role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:42.426937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:42.466044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03268-263e-47f1-b29b-5a4edce902f3 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.466380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03268-263e-47f1-b29b-5a4edce902f3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.466621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03268-263e-47f1-b29b-5a4edce902f3 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.468010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 119/234] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:42.473077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033086-aecc-4452-a55d-0cd8d1024df8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.473368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033086-aecc-4452-a55d-0cd8d1024df8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.473688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033086-aecc-4452-a55d-0cd8d1024df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.492941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4b033086-aecc-4452-a55d-0cd8d1024df8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:42.494163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4b033086-aecc-4452-a55d-0cd8d1024df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:42.528032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 116/235] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:42 2022] PUT /identity/v3/projects/6511d05de70544bfb533be84d6340a44/users/41b17042ea674831a017054dff031983/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:35:42.573155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 120/236] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:42.599942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:42.746028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d712-9bf1-4e4c-bc21-6ef6c42596d6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:42.787459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040c95-9a39-485e-bf28-b492beb4a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:42.788128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040c95-9a39-485e-bf28-b492beb4a36d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.788415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040c95-9a39-485e-bf28-b492beb4a36d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.788694 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040c95-9a39-485e-bf28-b492beb4a36d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.789986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040c95-9a39-485e-bf28-b492beb4a36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:42.791459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040c95-9a39-485e-bf28-b492beb4a36d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:42.793631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 117/237] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:42.798641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033086-aecc-4452-a55d-0cd8d1024df8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:42.846134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413c65-0c69-4ff1-a299-ac0e7682880e None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.846443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413c65-0c69-4ff1-a299-ac0e7682880e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.846701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413c65-0c69-4ff1-a299-ac0e7682880e None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.848403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 118/238] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:42.856033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba41d-f1b7-4293-b2f1-e984e3904b8e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:42.856383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba41d-f1b7-4293-b2f1-e984e3904b8e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:42.856766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba41d-f1b7-4293-b2f1-e984e3904b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:42.878692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4dbba41d-f1b7-4293-b2f1-e984e3904b8e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:42.879924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4dbba41d-f1b7-4293-b2f1-e984e3904b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:42.927588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:42.928146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:42.961723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 119/239] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:42.967572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033086-aecc-4452-a55d-0cd8d1024df8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:42.988154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbba41d-f1b7-4293-b2f1-e984e3904b8e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.030847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e53e5-c416-47bd-8f48-c51f62f89d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:43.031501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e53e5-c416-47bd-8f48-c51f62f89d8c None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.031791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e53e5-c416-47bd-8f48-c51f62f89d8c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.032366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e53e5-c416-47bd-8f48-c51f62f89d8c None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.033073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e53e5-c416-47bd-8f48-c51f62f89d8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:43.035108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e53e5-c416-47bd-8f48-c51f62f89d8c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:43.128022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 121/240] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:35:42 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:43.130838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbba41d-f1b7-4293-b2f1-e984e3904b8e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:43.175400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:43.176332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.176762 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.177214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.190849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:43.197224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:43.198297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:43.199245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:43.205576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c409e4-6017-421e-b71b-76eafabcce41 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.205576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c409e4-6017-421e-b71b-76eafabcce41 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.205576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c409e4-6017-421e-b71b-76eafabcce41 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.206258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 120/241] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:43.207334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 122/242] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:43.207894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.216179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2cd5-0621-462b-9d20-75f810e97307 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.216613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2cd5-0621-462b-9d20-75f810e97307 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.217046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2cd5-0621-462b-9d20-75f810e97307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.254736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:43.309552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0b7a2cd5-0621-462b-9d20-75f810e97307 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:43.312081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0b7a2cd5-0621-462b-9d20-75f810e97307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:43.338426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eb332-c6d4-4aa4-80d9-1c26e9737a7f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:43.397357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:43.398328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.398683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.399035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.399844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:43.400294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:43.402047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:43.417449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 121/243] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:43.419167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.420222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 123/244] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:43.460606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2cd5-0621-462b-9d20-75f810e97307 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.528141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:43.534496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:43.536880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673d9c8-441b-4d23-8dba-5f088c8209ce None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:43.589864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2cd5-0621-462b-9d20-75f810e97307 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:43.596536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:43.597983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.598676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.599372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] PATH_INFO: `/v3/users/9fcb553a069d4192b89df3a05ebd2e41` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.627932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] RBAC: Authorizing `identity:get_user(user_id=9fcb553a069d4192b89df3a05ebd2e41)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:43.629899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:43.630621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.630992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.631332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.632121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:43.639798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 122/245] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:43 2022] GET /identity/v3/users/9fcb553a069d4192b89df3a05ebd2e41 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:43.643649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.647311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:43.659135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:43.661623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:43.667158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 124/246] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:43.673683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.800196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662cc7a-d784-49f0-bc3d-2c16b17152b1 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:43.801762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276aa78-0499-45ef-b5bd-4fff444b37b6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:43.821026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:43.843152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:43.843152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.843152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.843152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.843515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:43.843515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:43.844524 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:43.854246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:43.855302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.855547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 125/247] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:43.855975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.856462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.864371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.902972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:43.968686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:43.970258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:44.023805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d941a6-7db3-4bdd-98f3-7f6689135b56 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:44.070252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:44.071548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.072035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.072533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] PATH_INFO: `/v3/users/dab1704870634b9e8da1066511314cfe` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.074586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] RBAC: Authorizing `identity:get_user(user_id=dab1704870634b9e8da1066511314cfe)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:44.076744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:44.079311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 126/248] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:43 2022] GET /identity/v3/users/dab1704870634b9e8da1066511314cfe => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:44.087448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:44.097621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 123/249] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:44.100364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:44.159457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:44.170999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:44.244481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd347700-cf7a-4487-b63c-660a72035860 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:44.249599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ead35f-84d0-4a7f-99cb-986fbcb3c641 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:44.295962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:44.301563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.301563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.301563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.301563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:44.305109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:44.306940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 127/250] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:44 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:44.315475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:44.332137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:44.332875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.333164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.333441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.334767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:44.336263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:44.342719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 124/251] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:44 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:44.344074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:44.532696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684654af-9a3e-4f6c-8039-a837c8e38e13 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:44.549282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:44.576877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164efdf-502d-48ae-8254-f69c75a79180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:44.577592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164efdf-502d-48ae-8254-f69c75a79180 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.577877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164efdf-502d-48ae-8254-f69c75a79180 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.578155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164efdf-502d-48ae-8254-f69c75a79180 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44/users/dab1704870634b9e8da1066511314cfe/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.585395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164efdf-502d-48ae-8254-f69c75a79180 None admin] RBAC: Authorizing `identity:create_grant(project_id=6511d05de70544bfb533be84d6340a44, user_id=dab1704870634b9e8da1066511314cfe, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:44.587483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164efdf-502d-48ae-8254-f69c75a79180 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:44.593042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ca55-6848-43b4-a553-61bf198ebeb6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:44.616945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:44.633376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878efa90-f75e-4d47-8845-4c291e7d513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:44.633984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878efa90-f75e-4d47-8845-4c291e7d513b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.634262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878efa90-f75e-4d47-8845-4c291e7d513b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.634533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878efa90-f75e-4d47-8845-4c291e7d513b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.635395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878efa90-f75e-4d47-8845-4c291e7d513b None admin] RBAC: Adding query filter params (role.id=348e984331e04238983705ce2056932d, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=9fcb553a069d4192b89df3a05ebd2e41) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:44.635710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878efa90-f75e-4d47-8845-4c291e7d513b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:44.637161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878efa90-f75e-4d47-8845-4c291e7d513b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:44.644579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 125/252] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:44 2022] GET /identity/v3/role_assignments?user.id=9fcb553a069d4192b89df3a05ebd2e41&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=348e984331e04238983705ce2056932d => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:44.723541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 128/253] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:44 2022] PUT /identity/v3/projects/6511d05de70544bfb533be84d6340a44/users/dab1704870634b9e8da1066511314cfe/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:44.944365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f7186-7981-4c60-bcf7-cfc5fe34c62b None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.944667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f7186-7981-4c60-bcf7-cfc5fe34c62b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.944836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f7186-7981-4c60-bcf7-cfc5fe34c62b None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.946803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 126/254] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:44.953627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575c31a-cbbf-4fc0-be81-d60a27ec4529 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.954115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575c31a-cbbf-4fc0-be81-d60a27ec4529 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.954398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575c31a-cbbf-4fc0-be81-d60a27ec4529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.977238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-f575c31a-cbbf-4fc0-be81-d60a27ec4529 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:44.978531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f575c31a-cbbf-4fc0-be81-d60a27ec4529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:45.083597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 129/255] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:45.122763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f7186-7981-4c60-bcf7-cfc5fe34c62b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:45.263660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f7186-7981-4c60-bcf7-cfc5fe34c62b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:45.320292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:45.321164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:45.321593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:45.321970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:45.346624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:45.352683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:45.353621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:45.354418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 127/256] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:35:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:45.359853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575c31a-cbbf-4fc0-be81-d60a27ec4529 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:45.506707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575c31a-cbbf-4fc0-be81-d60a27ec4529 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:45.510647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:45.554365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:45.554927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:45.555208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:45.555478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:45.556220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:45.556550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:45.558131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:45.569886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 130/257] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:45.576282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:45.654173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:45.719124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac4eb-668f-4c2a-8afc-7f075e831d0a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:45.765669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:45.766665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:45.767152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:45.767631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] PATH_INFO: `/v3/users/41b17042ea674831a017054dff031983` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:45.769013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] RBAC: Authorizing `identity:get_user(user_id=41b17042ea674831a017054dff031983)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:45.770739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:45.774411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 128/258] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:45 2022] GET /identity/v3/users/41b17042ea674831a017054dff031983 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:45.779213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:45.914010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a3787-350c-42d8-9d77-d4b40674cc09 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:45.962221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc08c4-0885-4e15-b7bb-27c700500373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:45.963338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc08c4-0885-4e15-b7bb-27c700500373 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:45.963826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc08c4-0885-4e15-b7bb-27c700500373 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:45.964305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc08c4-0885-4e15-b7bb-27c700500373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.009726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:46.054156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc08c4-0885-4e15-b7bb-27c700500373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:46.056059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc08c4-0885-4e15-b7bb-27c700500373 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:46.199302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 131/259] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:46.201202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:46.249246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127df7-4b2b-402d-82f8-e620825754c3 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.249602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127df7-4b2b-402d-82f8-e620825754c3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.249894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127df7-4b2b-402d-82f8-e620825754c3 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.251396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 132/260] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:46.258655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b8d2-89d8-4eef-b315-baf50da9161f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.259257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b8d2-89d8-4eef-b315-baf50da9161f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.259737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b8d2-89d8-4eef-b315-baf50da9161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.281329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d477b8d2-89d8-4eef-b315-baf50da9161f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:46.282987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d477b8d2-89d8-4eef-b315-baf50da9161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:46.420377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fed8b-c3e9-4a6f-b8d9-ac6a99de7a50 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:46.420900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:46.430656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 133/261] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:46.450800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:46.470454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b8d2-89d8-4eef-b315-baf50da9161f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:46.483190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:46.483913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.484199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.484480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.490240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:46.492207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:46.494274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 129/262] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:46 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:46.502966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:46.654566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b8d2-89d8-4eef-b315-baf50da9161f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:46.735511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:46.736102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.736386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.736661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.763209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa4162-9c25-4caa-b40d-109644c6aeca None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:46.766153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:46.771142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:46.771991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:46.772762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:46.781100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 134/263] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:46.782020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:46.836611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5ca14-b141-4e06-9e12-0c19cc3e4453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:46.837708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ca14-b141-4e06-9e12-0c19cc3e4453 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.838281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ca14-b141-4e06-9e12-0c19cc3e4453 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.838806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ca14-b141-4e06-9e12-0c19cc3e4453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.840037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5ca14-b141-4e06-9e12-0c19cc3e4453 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=41b17042ea674831a017054dff031983) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:46.840622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5ca14-b141-4e06-9e12-0c19cc3e4453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:46.842313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5ca14-b141-4e06-9e12-0c19cc3e4453 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:46.855790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 130/264] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:46 2022] GET /identity/v3/role_assignments?user.id=41b17042ea674831a017054dff031983&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:46.894344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffc94e-6172-46ee-a7d8-683bd62a1ca0 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.894966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffc94e-6172-46ee-a7d8-683bd62a1ca0 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.895474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffc94e-6172-46ee-a7d8-683bd62a1ca0 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.897176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 131/265] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:46.907150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820004-a499-4f3a-88ad-36f49d39a995 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.908017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:46.909010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820004-a499-4f3a-88ad-36f49d39a995 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.909613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820004-a499-4f3a-88ad-36f49d39a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.944757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-cc820004-a499-4f3a-88ad-36f49d39a995 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:46.947955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cc820004-a499-4f3a-88ad-36f49d39a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:46.969266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52e7c-d9a4-4bd2-b334-bb60ae9998bf None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:47.066428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da767c4-e5f5-4e4e-aa85-21473c0b1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:47.067080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da767c4-e5f5-4e4e-aa85-21473c0b1710 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.067364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da767c4-e5f5-4e4e-aa85-21473c0b1710 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.067642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da767c4-e5f5-4e4e-aa85-21473c0b1710 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.068379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da767c4-e5f5-4e4e-aa85-21473c0b1710 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:47.068685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da767c4-e5f5-4e4e-aa85-21473c0b1710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:47.072672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da767c4-e5f5-4e4e-aa85-21473c0b1710 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:47.073554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.088860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 135/266] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:47.089880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d8666-3eb1-441f-94ee-100120565ece None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.090181 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d8666-3eb1-441f-94ee-100120565ece None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.090437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d8666-3eb1-441f-94ee-100120565ece None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.097289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 136/267] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:47.105255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac71f6-3bdf-4a56-89cd-c409560375e6 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.106534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac71f6-3bdf-4a56-89cd-c409560375e6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.107722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac71f6-3bdf-4a56-89cd-c409560375e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.130145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 132/268] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:47.131358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc820004-a499-4f3a-88ad-36f49d39a995 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.145157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a3ac71f6-3bdf-4a56-89cd-c409560375e6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:47.146464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a3ac71f6-3bdf-4a56-89cd-c409560375e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:47.250659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 137/269] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:47.252490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac71f6-3bdf-4a56-89cd-c409560375e6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.311607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc820004-a499-4f3a-88ad-36f49d39a995 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:47.349064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:47.349639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.349914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.350185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] PATH_INFO: `/v3/users/41b17042ea674831a017054dff031983` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.351968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] RBAC: Authorizing `identity:get_user(user_id=41b17042ea674831a017054dff031983)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:47.353756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:47.355868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 133/270] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:47 2022] GET /identity/v3/users/41b17042ea674831a017054dff031983 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:47.356767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.403709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.426351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.482604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac71f6-3bdf-4a56-89cd-c409560375e6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:47.518614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31dec-3cca-40c3-927a-cc9ffa51562c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:47.537331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:47.538417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.539243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.539525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.540715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:47.542775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:47.545646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 138/271] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:47.546739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.557740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:47.558650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.558928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.559203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.571552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:47.576981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:47.583589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 134/272] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:47.585270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.682385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d45ce5-a53d-42a1-a4ce-d683a7822f5c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:47.703345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.706973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d884a-22e3-4029-abe0-234b4e931b7f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:47.713214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.727609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44cf73-a167-4b5a-a186-8657a54a32ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:47.728245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cf73-a167-4b5a-a186-8657a54a32ac None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.728667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cf73-a167-4b5a-a186-8657a54a32ac None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.728966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cf73-a167-4b5a-a186-8657a54a32ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.748532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:47.749705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.750194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.750695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.751724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:47.754059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:47.810370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cf73-a167-4b5a-a186-8657a54a32ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:47.810962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cf73-a167-4b5a-a186-8657a54a32ac None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:47.866155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 135/273] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:35:47 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:47.867599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.923932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 139/274] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:47.925283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79891-1d97-40f0-8a30-5033fc6a6bf8 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.925599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79891-1d97-40f0-8a30-5033fc6a6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.925881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79891-1d97-40f0-8a30-5033fc6a6bf8 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.927810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 140/275] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:47.929614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79891-1d97-40f0-8a30-5033fc6a6bf8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.956377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:48.012218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574614bb-eebd-4dff-9733-d40bce034317 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.056387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa807fb-a422-4c3a-9bf4-212fd5400546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.056387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa807fb-a422-4c3a-9bf4-212fd5400546 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.056387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa807fb-a422-4c3a-9bf4-212fd5400546 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.056741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa807fb-a422-4c3a-9bf4-212fd5400546 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.057344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa807fb-a422-4c3a-9bf4-212fd5400546 None admin] RBAC: Adding query filter params (name=member) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:48.057707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa807fb-a422-4c3a-9bf4-212fd5400546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:48.059376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa807fb-a422-4c3a-9bf4-212fd5400546 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:48.060759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79891-1d97-40f0-8a30-5033fc6a6bf8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.071377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 136/276] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:48.072684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d490e-690e-4b29-99b5-44ca60897f56 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.072973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d490e-690e-4b29-99b5-44ca60897f56 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.073252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d490e-690e-4b29-99b5-44ca60897f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.095267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8c9d490e-690e-4b29-99b5-44ca60897f56 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:48.097973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8c9d490e-690e-4b29-99b5-44ca60897f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:48.110247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.110905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.111220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.111936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.113676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:48.115313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:48.117950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 141/277] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:47 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:48.119424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:48.121735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:48.201079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 137/278] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:48.206711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d490e-690e-4b29-99b5-44ca60897f56 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:48.237403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:48.258250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c233c7-f691-468c-ac06-bf0d80998458 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.310451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35682128-2089-4383-bc6a-15bf32a20352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.311480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35682128-2089-4383-bc6a-15bf32a20352 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.311768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35682128-2089-4383-bc6a-15bf32a20352 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.312052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35682128-2089-4383-bc6a-15bf32a20352 None admin] PATH_INFO: `/v3/users/356be9a938894937bf9124c7db0cbd51` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.334513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35682128-2089-4383-bc6a-15bf32a20352 None admin] RBAC: Authorizing `identity:get_user(user_id=356be9a938894937bf9124c7db0cbd51)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:48.337023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35682128-2089-4383-bc6a-15bf32a20352 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:48.339625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d490e-690e-4b29-99b5-44ca60897f56 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.339780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 142/279] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/users/356be9a938894937bf9124c7db0cbd51 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:48.340842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a778b-0353-4747-a696-1e6b9f0a44cc None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.341121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a778b-0353-4747-a696-1e6b9f0a44cc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.341391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a778b-0353-4747-a696-1e6b9f0a44cc None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.343747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 143/280] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:48.344326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a778b-0353-4747-a696-1e6b9f0a44cc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:48.383977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.385106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.385691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.386272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.387330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] RBAC: Adding query filter params (role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=41b17042ea674831a017054dff031983) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:48.387852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:48.389806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:48.399471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 138/281] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/role_assignments?user.id=41b17042ea674831a017054dff031983&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:48.400617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:48.439255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:48.479160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a778b-0353-4747-a696-1e6b9f0a44cc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.525670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d06c3-fd47-42ad-a6fc-d4ed047fc313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.526457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d06c3-fd47-42ad-a6fc-d4ed047fc313 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.526650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d06c3-fd47-42ad-a6fc-d4ed047fc313 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.526934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d06c3-fd47-42ad-a6fc-d4ed047fc313 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.540665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d06c3-fd47-42ad-a6fc-d4ed047fc313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-dc2d06c3-fd47-42ad-a6fc-d4ed047fc313 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:48.546392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:48.547375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:48.548160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:48.553113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 144/282] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:48.555343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67eb1-36f2-4eef-bfc9-478ab522d470 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.555676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67eb1-36f2-4eef-bfc9-478ab522d470 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.556054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67eb1-36f2-4eef-bfc9-478ab522d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.564279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:48.580258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-20a67eb1-36f2-4eef-bfc9-478ab522d470 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:48.582541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-20a67eb1-36f2-4eef-bfc9-478ab522d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:48.673198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec22a1-c022-4ccd-bf0f-cdf4f4b9c08a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.673767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 145/283] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:48.675883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a67eb1-36f2-4eef-bfc9-478ab522d470 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:48.732129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.732727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.733014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.733295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.734296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, user.id=356be9a938894937bf9124c7db0cbd51, scope.system=all) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:48.734557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:48.736103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:48.743551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 139/284] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/role_assignments?user.id=356be9a938894937bf9124c7db0cbd51&scope.system=all&role.id=da9b6fc593c747e48d031adf8b20978d => generated 226 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:48.744410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:48.828221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a67eb1-36f2-4eef-bfc9-478ab522d470 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.858544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:48.867949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:48.874153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.874803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.875092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.875374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.876116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:48.876418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:48.877875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:48.891642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba982d20-6341-4545-994d-488e3ef766fc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:48.893942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 146/285] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:48.902719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:48.951742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:48.952850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:48.953340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:48.954021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:48.970600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:48.977974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:48.978937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:48.979718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:48.985222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 140/286] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:48.990584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:49.044914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06f49-6a82-4cc2-b571-402098743246 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:49.088294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:49.089554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:49.089554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:49.089741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] PATH_INFO: `/v3/users/9fcb553a069d4192b89df3a05ebd2e41` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:49.090892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] RBAC: Authorizing `identity:get_user(user_id=9fcb553a069d4192b89df3a05ebd2e41)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:49.092431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:49.094597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 147/287] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/users/9fcb553a069d4192b89df3a05ebd2e41 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:49.100538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:49.130501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42eb9e-a61d-485b-83bf-50f589350701 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:49.176143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:49.212673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:49.213308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:49.213651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:49.213972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:49.214761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] RBAC: Adding query filter params (name=member) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:49.215846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:49.218836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:49.223420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49b78d-8bd3-47a6-a73c-9b7af296745d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:49.240075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 141/288] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:49.262570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:49.265998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:49.266669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:49.266955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:49.267233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:49.268409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:49.269322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:49.272166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:49.279544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 148/289] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:49 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:49.280992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:49.405926 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82c5a3-25f5-431e-88c3-6807734c0d08 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:49.441224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:49.463574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:49.464921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:49.465200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:49.465479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44/users/9fcb553a069d4192b89df3a05ebd2e41/roles/348e984331e04238983705ce2056932d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:49.468928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58398-d20e-46c4-a23f-75d811eb972b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:49.471118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] RBAC: Authorizing `identity:create_grant(project_id=6511d05de70544bfb533be84d6340a44, user_id=9fcb553a069d4192b89df3a05ebd2e41, role_id=348e984331e04238983705ce2056932d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:49.472924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:49.515688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:49.516364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:49.516645 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:49.516919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] PATH_INFO: `/v3/users/dab1704870634b9e8da1066511314cfe` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:49.518206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] RBAC: Authorizing `identity:get_user(user_id=dab1704870634b9e8da1066511314cfe)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:49.519713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:49.521699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 142/290] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:49 2022] GET /identity/v3/users/dab1704870634b9e8da1066511314cfe => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:49.527715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:49.577844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 149/291] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:35:49 2022] PUT /identity/v3/projects/6511d05de70544bfb533be84d6340a44/users/9fcb553a069d4192b89df3a05ebd2e41/roles/348e984331e04238983705ce2056932d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:49.623765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:49.660973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c952f0c-0fe8-426f-8b15-982210accd0b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:49.707240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:49.707882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:49.708170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:49.708452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:49.788152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:49.789631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:49.883436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:49.924861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 143/292] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:49.930587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:50.063015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e9785-7dcd-4b80-844e-7a3cf44a1357 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:50.102040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f50b-150d-44e7-b637-afebb5372455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:50.102696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f50b-150d-44e7-b637-afebb5372455 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.102980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f50b-150d-44e7-b637-afebb5372455 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.103269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f50b-150d-44e7-b637-afebb5372455 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.104469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2f50b-150d-44e7-b637-afebb5372455 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:50.105947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2f50b-150d-44e7-b637-afebb5372455 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:50.107912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 150/293] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:49 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:50.113807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:50.237851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b633b7-11d2-47e5-b5ea-6f9a3d408519 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:50.291307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd53eea-feb4-40b2-817f-f2431a353c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:50.291954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd53eea-feb4-40b2-817f-f2431a353c38 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.292244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd53eea-feb4-40b2-817f-f2431a353c38 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.292527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd53eea-feb4-40b2-817f-f2431a353c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.293336 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd53eea-feb4-40b2-817f-f2431a353c38 None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=dab1704870634b9e8da1066511314cfe) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:50.293959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd53eea-feb4-40b2-817f-f2431a353c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:50.295141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd53eea-feb4-40b2-817f-f2431a353c38 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:50.302021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 144/294] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:50 2022] GET /identity/v3/role_assignments?user.id=dab1704870634b9e8da1066511314cfe&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=da9b6fc593c747e48d031adf8b20978d => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:50.552218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ce92-64a7-4617-9e2e-dd977c28aa58 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.552514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ce92-64a7-4617-9e2e-dd977c28aa58 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.552855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ce92-64a7-4617-9e2e-dd977c28aa58 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.554565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 151/295] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:50.559753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647bf8a-81cf-41e6-822f-0b7a0debd956 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.560208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647bf8a-81cf-41e6-822f-0b7a0debd956 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.560400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647bf8a-81cf-41e6-822f-0b7a0debd956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.586659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-5647bf8a-81cf-41e6-822f-0b7a0debd956 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:50.587872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5647bf8a-81cf-41e6-822f-0b7a0debd956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:50.621539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:50.625328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c65e41-4970-43a8-954f-a0fc070bb6c1 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.625804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c65e41-4970-43a8-954f-a0fc070bb6c1 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.625977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c65e41-4970-43a8-954f-a0fc070bb6c1 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.627475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 152/296] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:50.633540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9bd48-e002-44e0-a264-807004841ad9 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.633898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9bd48-e002-44e0-a264-807004841ad9 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.634258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9bd48-e002-44e0-a264-807004841ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.658399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-bee9bd48-e002-44e0-a264-807004841ad9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:50.661549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bee9bd48-e002-44e0-a264-807004841ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:50.670142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 145/297] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:50.693334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647bf8a-81cf-41e6-822f-0b7a0debd956 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:50.723848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:50.742279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 153/298] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:50.766129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9bd48-e002-44e0-a264-807004841ad9 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:50.816780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647bf8a-81cf-41e6-822f-0b7a0debd956 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:50.860423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:50.861289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.861615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.862193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.876173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:50.877586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9bd48-e002-44e0-a264-807004841ad9 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:50.882518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:50.883383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:50.884324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 146/299] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:50.889837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:50.920383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:50.921128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.921490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.921862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.923093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:50.923347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:50.924717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:50.926745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 154/300] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:50.932327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:51.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:51.012781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a5cf-b681-4737-9a5f-f2a4dff24ec9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:51.049326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:51.049991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.050276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.050553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.051347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:51.051649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:51.053145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:51.065590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd6726-c963-423c-bdc6-539e9a24bbec None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:51.067296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 147/301] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:51.068661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:51.106440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:51.107355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.107814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.108286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] PATH_INFO: `/v3/groups` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.109122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:51.110946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:51.159402 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:51.174511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069ecb5-0286-47c0-818d-2197357586bc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:51.207672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c944f72-f004-4555-a6e2-faab82fba315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:51.208324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c944f72-f004-4555-a6e2-faab82fba315 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.208612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c944f72-f004-4555-a6e2-faab82fba315 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.208892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c944f72-f004-4555-a6e2-faab82fba315 None admin] PATH_INFO: `/v3/users/8fc667310bbb46f8848187d1b708d1ca` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.225566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 155/302] 10.222.0.77 () {60 vars in 1134 bytes} [Mon Aug 1 15:35:50 2022] POST /identity/v3/groups => generated 229 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:51.233301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c944f72-f004-4555-a6e2-faab82fba315 None admin] RBAC: Authorizing `identity:get_user(user_id=8fc667310bbb46f8848187d1b708d1ca)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:51.234841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c944f72-f004-4555-a6e2-faab82fba315 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:51.236647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 148/303] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:51 2022] GET /identity/v3/users/8fc667310bbb46f8848187d1b708d1ca => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:51.242796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:51.302033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a366e-dfc7-425f-902e-ff87ca192aa3 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.302386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a366e-dfc7-425f-902e-ff87ca192aa3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.302732 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a366e-dfc7-425f-902e-ff87ca192aa3 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.304535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 149/304] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:51.312367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81c8ba-0df0-4adb-a35c-7b53f1db1c03 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.312677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81c8ba-0df0-4adb-a35c-7b53f1db1c03 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.312946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81c8ba-0df0-4adb-a35c-7b53f1db1c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.338998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8a81c8ba-0df0-4adb-a35c-7b53f1db1c03 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:51.340567 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8a81c8ba-0df0-4adb-a35c-7b53f1db1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:51.390514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad7a81-e6bd-4f23-bd9d-573e967521ad None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:51.419891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:51.437158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 150/305] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:51.452870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:51.453864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.454330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.454797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.455807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] RBAC: Adding query filter params (role.id=348e984331e04238983705ce2056932d, user.id=8fc667310bbb46f8848187d1b708d1ca, scope.system=all) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:51.456125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:51.457649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:51.462051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81c8ba-0df0-4adb-a35c-7b53f1db1c03 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:51.464677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 156/306] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 1 15:35:51 2022] GET /identity/v3/role_assignments?user.id=8fc667310bbb46f8848187d1b708d1ca&scope.system=all&role.id=348e984331e04238983705ce2056932d => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:51.545054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:51.575267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81c8ba-0df0-4adb-a35c-7b53f1db1c03 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:51.613947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:51.614931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.615360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.615794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.633541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:51.638680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:51.639586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:51.640432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 151/307] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:51.647898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:51.755002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9a1e0-92a4-4b78-a796-328978aabc93 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:51.795123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:51.795754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.796080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.796362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.797083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:51.797388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:51.798798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:51.808634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 157/308] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:51.818650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:51.926163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575340-5a9b-4a60-8456-23099de19250 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:51.961711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153946c6-d5dc-42eb-aa16-b5329477c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:51.962392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153946c6-d5dc-42eb-aa16-b5329477c0ed None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:51.962680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153946c6-d5dc-42eb-aa16-b5329477c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:51.962954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153946c6-d5dc-42eb-aa16-b5329477c0ed None admin] PATH_INFO: `/v3/users/356be9a938894937bf9124c7db0cbd51` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:51.964117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153946c6-d5dc-42eb-aa16-b5329477c0ed None admin] RBAC: Authorizing `identity:get_user(user_id=356be9a938894937bf9124c7db0cbd51)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:51.965564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153946c6-d5dc-42eb-aa16-b5329477c0ed None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:51.967478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 152/309] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:51 2022] GET /identity/v3/users/356be9a938894937bf9124c7db0cbd51 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:51.974589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:52.021632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:52.082119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4e76a-2a29-4299-8df6-f0eb8cc51c7c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:52.116760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:52.117424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:52.117750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:52.118110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] PATH_INFO: `/v3/system/users/356be9a938894937bf9124c7db0cbd51/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:52.119602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=356be9a938894937bf9124c7db0cbd51, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:52.120990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:52.209601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b637419-f9f9-4ccb-b0a4-9e3984a4f246 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:52.209896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b637419-f9f9-4ccb-b0a4-9e3984a4f246 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:52.210199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b637419-f9f9-4ccb-b0a4-9e3984a4f246 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:52.212445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 153/310] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:52.216993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c1c3-0a95-4bf1-b806-21c22941d96b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:52.218156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c1c3-0a95-4bf1-b806-21c22941d96b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:52.218156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c1c3-0a95-4bf1-b806-21c22941d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:52.224066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:52.236584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a971c1c3-0a95-4bf1-b806-21c22941d96b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:52.237810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a971c1c3-0a95-4bf1-b806-21c22941d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:52.265127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 158/311] 10.222.0.77 () {58 vars in 1334 bytes} [Mon Aug 1 15:35:51 2022] PUT /identity/v3/system/users/356be9a938894937bf9124c7db0cbd51/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:52.323177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 154/312] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:52.346654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:52.469329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9778fe-eba1-463a-9dbe-4ac84fee5363 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:52.477465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:52.506245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:52.507793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:52.508258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:52.508709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:52.520478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:52.525942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:52.526855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:52.527664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:52.529998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 159/313] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:52.539393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971c1c3-0a95-4bf1-b806-21c22941d96b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:52.643112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971c1c3-0a95-4bf1-b806-21c22941d96b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:52.721702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:52.728437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:52.729364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:52.729811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:52.730269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:52.736245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:52.736245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:52.736245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:52.742969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 155/314] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:52.748911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:52.860852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e161c-0d52-4e27-b9cb-09c6e03ac987 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:52.896358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:52.897002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:52.897283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:52.897610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] PATH_INFO: `/v3/users/9fcb553a069d4192b89df3a05ebd2e41` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:52.898785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] RBAC: Authorizing `identity:get_user(user_id=9fcb553a069d4192b89df3a05ebd2e41)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:52.900233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:52.902277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 160/315] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:52 2022] GET /identity/v3/users/9fcb553a069d4192b89df3a05ebd2e41 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:52.907438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:53.014521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0270-c398-41c5-a23c-a47c288ffdc8 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:53.050895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:53.051534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.051820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.052100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.118462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:53.126108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:53.127639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:53.230514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 156/316] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:53.236215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:53.283914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:53.351708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9773-2b98-4fbd-9946-6cdc07f41dcf None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:53.388396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c91b61-83f4-4c3e-81da-c150487e066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:53.389039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c91b61-83f4-4c3e-81da-c150487e066e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.389321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c91b61-83f4-4c3e-81da-c150487e066e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.389627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c91b61-83f4-4c3e-81da-c150487e066e None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.390797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c91b61-83f4-4c3e-81da-c150487e066e None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:53.392237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c91b61-83f4-4c3e-81da-c150487e066e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:53.394295 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 161/317] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:53 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:53.400711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:53.401566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df06b-0ca9-48d0-b660-5088a7b99815 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.402114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df06b-0ca9-48d0-b660-5088a7b99815 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.402548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df06b-0ca9-48d0-b660-5088a7b99815 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.404348 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 162/318] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:53.409561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3832-6994-4f37-92eb-661ade49b8ba None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.410066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3832-6994-4f37-92eb-661ade49b8ba None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.410539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3832-6994-4f37-92eb-661ade49b8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.430477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4dca3832-6994-4f37-92eb-661ade49b8ba None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:53.431782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4dca3832-6994-4f37-92eb-661ade49b8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:53.520343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:53.521402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 163/319] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:53.532279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24553ff8-39d2-4ba4-ba3b-7fcc0f220785 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:53.547117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca3832-6994-4f37-92eb-661ade49b8ba None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:53.574476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe3fc-31e3-419e-98fc-23826a6b5531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:53.575502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe3fc-31e3-419e-98fc-23826a6b5531 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.575991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe3fc-31e3-419e-98fc-23826a6b5531 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.576456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe3fc-31e3-419e-98fc-23826a6b5531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.577675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe3fc-31e3-419e-98fc-23826a6b5531 None admin] RBAC: Adding query filter params (role.id=348e984331e04238983705ce2056932d, scope.project.id=6511d05de70544bfb533be84d6340a44, user.id=9fcb553a069d4192b89df3a05ebd2e41) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:53.578231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe3fc-31e3-419e-98fc-23826a6b5531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:53.579918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe3fc-31e3-419e-98fc-23826a6b5531 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:53.581169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:53.588714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 157/320] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:35:53 2022] GET /identity/v3/role_assignments?user.id=9fcb553a069d4192b89df3a05ebd2e41&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=348e984331e04238983705ce2056932d => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:53.633282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d020e8-1c3e-48b3-af65-3bd6b6752292 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.633616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d020e8-1c3e-48b3-af65-3bd6b6752292 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.633892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d020e8-1c3e-48b3-af65-3bd6b6752292 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.635543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 158/321] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:53.641269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68255-5a92-46ad-b01c-a960b2792c26 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.641626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68255-5a92-46ad-b01c-a960b2792c26 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.641873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68255-5a92-46ad-b01c-a960b2792c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.662419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-37f68255-5a92-46ad-b01c-a960b2792c26 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:53.664411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-37f68255-5a92-46ad-b01c-a960b2792c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:53.668028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca3832-6994-4f37-92eb-661ade49b8ba None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:53.709810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:53.712719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.714008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.714500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.716626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:53.718569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:53.720902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 164/322] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:35:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:53.729506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:53.759251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 159/323] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:53.781873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68255-5a92-46ad-b01c-a960b2792c26 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:53.846858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:53.851298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c46037-c45e-4b9c-b812-e8d1a7bd2e2d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:53.888685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:53.897578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:53.898402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.898508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.898746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] PATH_INFO: `/v3/groups` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.899423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:53.900904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:53.901009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68255-5a92-46ad-b01c-a960b2792c26 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:53.936417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:53.937057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.937337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.937646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.948748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:53.953877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:53.954775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:53.955564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 160/324] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:53.960959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:54.030792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 165/325] 10.222.0.77 () {60 vars in 1134 bytes} [Mon Aug 1 15:35:53 2022] POST /identity/v3/groups => generated 226 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:35:54.073533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5335e8-8fd2-41d6-885e-8d53040d494d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:54.112688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:54.113286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.113684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.113959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.114700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:54.115007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:54.117143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:54.130414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 161/326] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:54.132973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:54.244766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd1a2-00c6-4c25-8040-b2be97a342d2 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:54.279954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080650-913b-4b03-9c33-90c9abf60c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:54.280847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080650-913b-4b03-9c33-90c9abf60c5e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.281301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080650-913b-4b03-9c33-90c9abf60c5e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.281764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080650-913b-4b03-9c33-90c9abf60c5e None admin] PATH_INFO: `/v3/users/8fc667310bbb46f8848187d1b708d1ca` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.283136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080650-913b-4b03-9c33-90c9abf60c5e None admin] RBAC: Authorizing `identity:get_user(user_id=8fc667310bbb46f8848187d1b708d1ca)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:54.284797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080650-913b-4b03-9c33-90c9abf60c5e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:54.286873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 166/327] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:54 2022] GET /identity/v3/users/8fc667310bbb46f8848187d1b708d1ca => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:54.293205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:54.312383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:54.405055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640f57a-f582-4f16-9fe7-7bc242f678ba None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:54.441476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:54.442251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.442533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.442816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] PATH_INFO: `/v3/system/users/8fc667310bbb46f8848187d1b708d1ca/roles/348e984331e04238983705ce2056932d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.444388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8fc667310bbb46f8848187d1b708d1ca, role_id=348e984331e04238983705ce2056932d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:54.445908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:54.452264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55542-1d07-4924-af5d-e45609f8b771 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.452562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55542-1d07-4924-af5d-e45609f8b771 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.452847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55542-1d07-4924-af5d-e45609f8b771 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.454305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 167/328] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:54.460616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7afbb-24cf-4195-8922-d78152a08857 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.460966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7afbb-24cf-4195-8922-d78152a08857 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.461248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7afbb-24cf-4195-8922-d78152a08857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.481465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-09c7afbb-24cf-4195-8922-d78152a08857 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:54.482791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-09c7afbb-24cf-4195-8922-d78152a08857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:54.509438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:54.516752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 162/329] 10.222.0.77 () {58 vars in 1334 bytes} [Mon Aug 1 15:35:54 2022] PUT /identity/v3/system/users/8fc667310bbb46f8848187d1b708d1ca/roles/348e984331e04238983705ce2056932d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:35:54.568025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 168/330] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:54.598470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:54.690746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:54.718153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c849c0-df1d-4226-98dc-313eee383c7a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:54.758237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:54.758900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.759187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.759466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.771572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:54.777684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:54.778614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:54.779428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 163/331] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:54.784800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7afbb-24cf-4195-8922-d78152a08857 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:54.898101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7afbb-24cf-4195-8922-d78152a08857 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:54.935634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:54.936259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.936545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.936826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.937594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:54.937907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:54.939309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:54.949330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 169/332] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:54.955002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:55.064522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67a5b5-7236-49f1-8fdd-20816688e9fa None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:55.104515 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372f531-fb00-4883-95eb-f166c62acc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:55.105180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372f531-fb00-4883-95eb-f166c62acc53 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:55.105468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372f531-fb00-4883-95eb-f166c62acc53 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:55.105779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372f531-fb00-4883-95eb-f166c62acc53 None admin] PATH_INFO: `/v3/users/356be9a938894937bf9124c7db0cbd51` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:55.110231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372f531-fb00-4883-95eb-f166c62acc53 None admin] RBAC: Authorizing `identity:get_user(user_id=356be9a938894937bf9124c7db0cbd51)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:55.112014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372f531-fb00-4883-95eb-f166c62acc53 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:55.114711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 164/333] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:54 2022] GET /identity/v3/users/356be9a938894937bf9124c7db0cbd51 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:55.120996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:55.144906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:55.237777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba696d-9936-4407-97b6-00e0d8805121 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:55.285443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7f059-5f3a-40d6-b6ff-63cc24568257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:55.286164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f059-5f3a-40d6-b6ff-63cc24568257 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:55.286458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f059-5f3a-40d6-b6ff-63cc24568257 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:55.286812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f059-5f3a-40d6-b6ff-63cc24568257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:55.287626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7f059-5f3a-40d6-b6ff-63cc24568257 None admin] RBAC: Adding query filter params (role.id=da9b6fc593c747e48d031adf8b20978d, user.id=356be9a938894937bf9124c7db0cbd51, scope.system=all) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:55.287941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7f059-5f3a-40d6-b6ff-63cc24568257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:55.291559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7f059-5f3a-40d6-b6ff-63cc24568257 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:55.306548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 170/334] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 1 15:35:55 2022] GET /identity/v3/role_assignments?user.id=356be9a938894937bf9124c7db0cbd51&scope.system=all&role.id=da9b6fc593c747e48d031adf8b20978d => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:56.419552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646759a-8d8a-4e51-8413-29a7123fbb47 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:56.420057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646759a-8d8a-4e51-8413-29a7123fbb47 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:56.420130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646759a-8d8a-4e51-8413-29a7123fbb47 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:56.421622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 165/335] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:56.427064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200b26-8c53-4d13-b3fe-acc98778f1cf None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:56.427899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200b26-8c53-4d13-b3fe-acc98778f1cf None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:56.428369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200b26-8c53-4d13-b3fe-acc98778f1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:56.456752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-14200b26-8c53-4d13-b3fe-acc98778f1cf None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:56.458273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-14200b26-8c53-4d13-b3fe-acc98778f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:56.546339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 171/336] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:56.569901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646759a-8d8a-4e51-8413-29a7123fbb47 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:56.573080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:56.664962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794f0fb-da46-4a4e-aa43-8f1625243b55 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:56.665614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794f0fb-da46-4a4e-aa43-8f1625243b55 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:56.666107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794f0fb-da46-4a4e-aa43-8f1625243b55 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:56.667712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 172/337] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:35:56.674391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881044e-5c4b-41ab-ab96-aa974836b30c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:56.674749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881044e-5c4b-41ab-ab96-aa974836b30c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:56.674958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881044e-5c4b-41ab-ab96-aa974836b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:56.699643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c881044e-5c4b-41ab-ab96-aa974836b30c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:56.700837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c881044e-5c4b-41ab-ab96-aa974836b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:56.702999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:56.781496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646759a-8d8a-4e51-8413-29a7123fbb47 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:56.845419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 173/338] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:56.850095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:56.850867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:56.851159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:56.851435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:56.862423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:56.868403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:56.869290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:56.870090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 166/339] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:56.876662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881044e-5c4b-41ab-ab96-aa974836b30c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:56.920825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.039009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881044e-5c4b-41ab-ab96-aa974836b30c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.039231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.102390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.102962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.103249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.103531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.104274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:57.104583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:57.106030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:57.111738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.120006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 174/340] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:57.121464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b7bf-69c7-432a-b66c-ddc48f2ccd6b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.128818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.222776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.223455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.223741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.224018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.257336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3ae63-e2df-4272-820c-1970c333733f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.261510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:57.271665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:57.272998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:57.274658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:57.284590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 167/341] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:35:57.296447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.297621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.298278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.298568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.298852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.381858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:57.383395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:57.400705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.497399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 175/342] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:57.503375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.547183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb17ef-34db-42ad-b1c5-9a14ecf1e865 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.605352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.616200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33fd17-0ab7-44fd-8982-fa57f50dde95 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.621206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.636557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.637139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.637419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.637717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.638462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:57.638765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:57.640195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:57.656451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 168/343] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:57.659301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.659953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.660235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.660511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.661719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:57.663825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:57.664445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.665509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 176/344] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:57 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:57.671442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.778785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8501-386a-4cd7-a425-cb6688783a06 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.817059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325ef5-4a2b-462e-b60d-8cc2b942aa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.817783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325ef5-4a2b-462e-b60d-8cc2b942aa75 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.818075 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325ef5-4a2b-462e-b60d-8cc2b942aa75 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.818354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325ef5-4a2b-462e-b60d-8cc2b942aa75 None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.825448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325ef5-4a2b-462e-b60d-8cc2b942aa75 None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:57.826951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325ef5-4a2b-462e-b60d-8cc2b942aa75 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:57.828921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 177/345] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:35:57 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:57.830140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b53cd-66b8-4022-989e-5125699d555e None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.830431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b53cd-66b8-4022-989e-5125699d555e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.830713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b53cd-66b8-4022-989e-5125699d555e None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.838138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 178/346] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:57.843347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b53cd-66b8-4022-989e-5125699d555e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.853703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582dcc-a6b4-4014-bf7d-c7d76766ac57 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.901980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.932215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33944fa-2e2e-4e5b-9bce-4570cf02ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.932848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33944fa-2e2e-4e5b-9bce-4570cf02ef52 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.933395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33944fa-2e2e-4e5b-9bce-4570cf02ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.933698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33944fa-2e2e-4e5b-9bce-4570cf02ef52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.041849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:58.048993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b53cd-66b8-4022-989e-5125699d555e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:58.075470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33944fa-2e2e-4e5b-9bce-4570cf02ef52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:58.076963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33944fa-2e2e-4e5b-9bce-4570cf02ef52 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:58.118973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1725ec7-37b8-4921-8a47-b84cc70d4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:58.119619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725ec7-37b8-4921-8a47-b84cc70d4f33 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.119906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725ec7-37b8-4921-8a47-b84cc70d4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.120186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725ec7-37b8-4921-8a47-b84cc70d4f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.122167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1725ec7-37b8-4921-8a47-b84cc70d4f33 None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:58.122490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1725ec7-37b8-4921-8a47-b84cc70d4f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:58.123963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1725ec7-37b8-4921-8a47-b84cc70d4f33 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:58.138060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 179/347] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:35:57 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=da9b6fc593c747e48d031adf8b20978d => generated 260 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:58.139581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e3b7-4717-4432-bbb4-27eec42b97aa None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.139848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e3b7-4717-4432-bbb4-27eec42b97aa None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.140130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e3b7-4717-4432-bbb4-27eec42b97aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.165897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-30e1e3b7-4717-4432-bbb4-27eec42b97aa None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:58.167054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-30e1e3b7-4717-4432-bbb4-27eec42b97aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:58.253738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 169/348] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:58.255726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2202-297d-4005-b426-6e8ee696b306 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.256020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2202-297d-4005-b426-6e8ee696b306 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.256836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2202-297d-4005-b426-6e8ee696b306 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.258869 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 170/349] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:58.260631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2202-297d-4005-b426-6e8ee696b306 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:58.264225 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 180/350] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:58.267193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79135d96-3156-4dce-9b51-2e936cf60eb6 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.267483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79135d96-3156-4dce-9b51-2e936cf60eb6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.267757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79135d96-3156-4dce-9b51-2e936cf60eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.291546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-79135d96-3156-4dce-9b51-2e936cf60eb6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:58.292746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-79135d96-3156-4dce-9b51-2e936cf60eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:58.320508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:58.395032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 181/351] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:35:58.395944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79135d96-3156-4dce-9b51-2e936cf60eb6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:58.415374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:58.455975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2202-297d-4005-b426-6e8ee696b306 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:58.500566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:58.501484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.501948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.502391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.503849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:58.505600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:58.507971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 171/352] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:58 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:35:58.509920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:58.520512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79135d96-3156-4dce-9b51-2e936cf60eb6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:58.563667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d706791-59ff-4a4e-b918-23da6e8496dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:58.564469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706791-59ff-4a4e-b918-23da6e8496dd None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.564794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706791-59ff-4a4e-b918-23da6e8496dd None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.565078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706791-59ff-4a4e-b918-23da6e8496dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.579817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706791-59ff-4a4e-b918-23da6e8496dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-6d706791-59ff-4a4e-b918-23da6e8496dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:58.587377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:58.588330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:35:58.589160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:58.590601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 182/353] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:58.591213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb3c6-0007-48ee-a63b-68c4935f7780 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.591537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb3c6-0007-48ee-a63b-68c4935f7780 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.592114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb3c6-0007-48ee-a63b-68c4935f7780 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.597549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 183/354] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:58.597549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb3c6-0007-48ee-a63b-68c4935f7780 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:58.626083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:58.651830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6695e-ae20-4c1b-900e-9e5b7793b3f6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:58.703506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:58.704074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.704364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.704644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.720066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:58.726277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb3c6-0007-48ee-a63b-68c4935f7780 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:58.726421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:58.727263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:35:58.728671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 172/355] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:35:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:58.729412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:58.748709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:58.777194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954dc2-e211-49a5-bd45-d35a95d0b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:58.777890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954dc2-e211-49a5-bd45-d35a95d0b3fc None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.778178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954dc2-e211-49a5-bd45-d35a95d0b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.778458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954dc2-e211-49a5-bd45-d35a95d0b3fc None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.781014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954dc2-e211-49a5-bd45-d35a95d0b3fc None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:58.782865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954dc2-e211-49a5-bd45-d35a95d0b3fc None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:58.789392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 184/356] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:35:58 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:58.789392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc639b-a0a2-4994-985e-8ac5cbc582e4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.789392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc639b-a0a2-4994-985e-8ac5cbc582e4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.789392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc639b-a0a2-4994-985e-8ac5cbc582e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.810608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-51dc639b-a0a2-4994-985e-8ac5cbc582e4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:58.813222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-51dc639b-a0a2-4994-985e-8ac5cbc582e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:58.879396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f568c5-1534-4cea-9ade-4596cda8c72a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:58.909539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 185/357] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:58.909539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc639b-a0a2-4994-985e-8ac5cbc582e4 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:58.921891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:58.938788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:58.939825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:58.940393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:58.940895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:58.941748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:58.942171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:58.944638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:58.957339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 173/358] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:58.958976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.029633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc639b-a0a2-4994-985e-8ac5cbc582e4 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.043487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.072059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbff5ab-5737-445d-a9ed-c9b6d4ed14f1 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.074085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.076282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.076560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.076944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.078740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:59.079166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:59.080702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:59.092380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 186/359] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:59.093709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.122765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.123879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.124530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.125231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.127008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:59.127801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:59.130067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:59.144490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 174/360] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:35:58 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:59.144490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.234370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.268278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88df94-571c-4588-9f25-89624c533e37 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.317433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.318149 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.318433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.318726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.330699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:35:59.338193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:35:59.339140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:35:59.340364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 187/361] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:35:59.341041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.384082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935e290-17eb-4b2a-994f-58038c20a40b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.427339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf160-a5f7-4a31-b29d-8481758eddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.428409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf160-a5f7-4a31-b29d-8481758eddd7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.428901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf160-a5f7-4a31-b29d-8481758eddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.429382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf160-a5f7-4a31-b29d-8481758eddd7 None admin] PATH_INFO: `/v3/users/8fc667310bbb46f8848187d1b708d1ca` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.430807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf160-a5f7-4a31-b29d-8481758eddd7 None admin] RBAC: Authorizing `identity:get_user(user_id=8fc667310bbb46f8848187d1b708d1ca)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:59.432476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf160-a5f7-4a31-b29d-8481758eddd7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:59.434856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 175/362] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/users/8fc667310bbb46f8848187d1b708d1ca => generated 293 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:59.436223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ff21-1154-427a-9c3e-9149d1eb03cf None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.436727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ff21-1154-427a-9c3e-9149d1eb03cf None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.437217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ff21-1154-427a-9c3e-9149d1eb03cf None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.442930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 176/363] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:35:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:35:59.444497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ff21-1154-427a-9c3e-9149d1eb03cf None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.454784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.466897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420d4a-97ea-42e6-984e-8d53022e4a79 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.505306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828fecf-5d52-4405-beb4-e664450b5711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.506359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fecf-5d52-4405-beb4-e664450b5711 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.507450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fecf-5d52-4405-beb4-e664450b5711 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.507924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fecf-5d52-4405-beb4-e664450b5711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.512057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.560724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ff21-1154-427a-9c3e-9149d1eb03cf None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.597600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828fecf-5d52-4405-beb4-e664450b5711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:59.600003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828fecf-5d52-4405-beb4-e664450b5711 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:59.601102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.601763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.602102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.602376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.603142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:59.603452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:59.605856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:59.619275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 177/364] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:59.619275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.720934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.745458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 188/365] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:59.747464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b40ac-4f98-4041-bfbf-8ba65779b841 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.747967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b40ac-4f98-4041-bfbf-8ba65779b841 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.748477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b40ac-4f98-4041-bfbf-8ba65779b841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.766692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123863dc-5b35-4f99-a224-1cb6d75ab3ab None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.768857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7f1b40ac-4f98-4041-bfbf-8ba65779b841 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:59.770403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7f1b40ac-4f98-4041-bfbf-8ba65779b841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:59.809134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.812902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.813471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.813777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.814053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.814842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] RBAC: Adding query filter params (role.id=348e984331e04238983705ce2056932d, user.id=8fc667310bbb46f8848187d1b708d1ca, scope.system=all) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:35:59.815152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:59.816603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:59.832605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 178/366] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/role_assignments?user.id=8fc667310bbb46f8848187d1b708d1ca&scope.system=all&role.id=348e984331e04238983705ce2056932d => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:35:59.833441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.864433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 189/367] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:59.866476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b40ac-4f98-4041-bfbf-8ba65779b841 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.951261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e61bf-dd6f-416e-a851-0e320549eb72 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.979949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.985645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b40ac-4f98-4041-bfbf-8ba65779b841 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.989966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.990411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.991891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.991891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.028839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.029879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.030402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.030975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.032439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.034228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.036134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 190/368] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:00.037398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.069014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.071154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.078265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.156031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6479cc-d939-443d-bea0-437d440c98d5 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.181469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 179/369] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:00.181469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.201713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.202688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.203189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.203745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.206583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.216371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:00.222060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:00.222970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:00.223736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:00.227033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 191/370] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:00.228145 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.283712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d6a25-7c3a-433c-8a96-5f3bffc280a0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.321227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.321816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.322088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.322362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.323505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.325373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.327000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 180/371] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:00.327841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.339141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.347386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6aa7a-53b6-43b6-8b64-c4e8c486a946 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.387222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.388344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.388903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.389399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.390916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.392715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.394886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 192/372] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:00.395989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.426562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.433172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdf501-4b43-4c5a-9e34-5eeb191d5748 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.469941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.470561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.470844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.471112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.471919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:00.472223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.473616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.483994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 181/373] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:00.484839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.514770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a753b3e-c509-474d-a733-6bf4f2ba5541 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.554634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.555631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.556115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.556607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.557739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=6511d05de70544bfb533be84d6340a44) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:00.558615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.560328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.566831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 193/374] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=da9b6fc593c747e48d031adf8b20978d => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:00.568167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.591797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353408b2-5638-4871-957e-7e7c11859ac7 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.602907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.630221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.630892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.631174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.631518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.632792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.634353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.636016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 182/375] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:00.642069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.671318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.697473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f58301-5690-4014-b126-4151ef6597ae None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.740502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af9be9-db00-4f15-935a-5f68d6d3a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.741817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9be9-db00-4f15-935a-5f68d6d3a130 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.742353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9be9-db00-4f15-935a-5f68d6d3a130 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.743132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9be9-db00-4f15-935a-5f68d6d3a130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.755828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cdf88-c420-48ca-8a1e-8d2e3884764f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:00.793529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:00.794173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.794454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.794729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.795532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=6511d05de70544bfb533be84d6340a44) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:00.795843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.797356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.809965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 183/376] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:00.830256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af9be9-db00-4f15-935a-5f68d6d3a130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.832354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af9be9-db00-4f15-935a-5f68d6d3a130 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.866953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.961254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 194/377] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:00.966745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:00.990756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667613-1af4-4b29-9f67-122adf0b6b53 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:00.991522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667613-1af4-4b29-9f67-122adf0b6b53 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:00.992010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667613-1af4-4b29-9f67-122adf0b6b53 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:00.995816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 195/378] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:01.006912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c542b-4a96-44b6-9da1-9cbe87a2b29e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:01.007198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c542b-4a96-44b6-9da1-9cbe87a2b29e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:01.007511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c542b-4a96-44b6-9da1-9cbe87a2b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:01.035168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-591c542b-4a96-44b6-9da1-9cbe87a2b29e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:01.036405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-591c542b-4a96-44b6-9da1-9cbe87a2b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:01.142595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 196/379] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:01.169889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:01.177382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c542b-4a96-44b6-9da1-9cbe87a2b29e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:01.198272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c602-4e4e-4c2c-8d71-e1b11ac5ed48 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:01.250246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:01.251319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:01.251804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:01.252301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] PATH_INFO: `/v3/projects/0c484252c6e543fcb5b380854c3b730a` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:01.253771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] RBAC: Authorizing `identity:get_project(project_id=0c484252c6e543fcb5b380854c3b730a)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:01.255465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:01.258309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 184/380] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:00 2022] GET /identity/v3/projects/0c484252c6e543fcb5b380854c3b730a => generated 344 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:01.263779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:01.294059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:01.380337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c542b-4a96-44b6-9da1-9cbe87a2b29e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:01.419887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a8ff-a9ca-4370-b52e-32e64d3cdd8f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:01.442105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:01.443200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:01.443631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:01.444672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:01.461792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:01.470539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:01.471460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:01.472250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:01.473056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 197/381] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:01.479131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:01.504303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:01.505345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:01.505872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:01.506951 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] PATH_INFO: `/v3/groups/997386dbe3174fa39112da53f779e8fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:01.520617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] RBAC: Authorizing `identity:get_group(group_id=997386dbe3174fa39112da53f779e8fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:01.522510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:01.524763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 185/382] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:01 2022] GET /identity/v3/groups/997386dbe3174fa39112da53f779e8fd => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:01.530767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:01.585897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:01.659510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed679-5af2-45f9-aac9-54f205464414 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:01.688981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:01.719404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:01.720308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:01.720762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:01.721179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:01.722433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] RBAC: Adding query filter params (name=member) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:01.724250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:01.727195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:01.741858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 198/383] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:36:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:01.748148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:01.795084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859231-aaaa-408f-829c-c6e0bc121eea None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:01.880766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:01.882389 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:01.883423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:01.883857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:01.885158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] RBAC: Adding query filter params (group.id=997386dbe3174fa39112da53f779e8fd, role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=0c484252c6e543fcb5b380854c3b730a) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:01.885661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:01.888906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:01.900803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 186/384] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:01 2022] GET /identity/v3/role_assignments?group.id=997386dbe3174fa39112da53f779e8fd&scope.project.id=0c484252c6e543fcb5b380854c3b730a&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 260 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:01.989742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba14fb-ba0d-40e7-82ac-82b523472a06 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:02.049920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057059-c475-405e-8a6f-014e9291abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:02.050604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057059-c475-405e-8a6f-014e9291abdb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.050884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057059-c475-405e-8a6f-014e9291abdb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.051161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057059-c475-405e-8a6f-014e9291abdb None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.058817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057059-c475-405e-8a6f-014e9291abdb None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:02.060327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057059-c475-405e-8a6f-014e9291abdb None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:02.062468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 199/385] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:01 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:02.067970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:02.123628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1c96-1849-4203-ba15-5b36afff77d2 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.123913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1c96-1849-4203-ba15-5b36afff77d2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.124197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1c96-1849-4203-ba15-5b36afff77d2 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.125891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 200/386] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:02.142651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c1c8d-7338-491b-909d-e4ed8c8f604a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.142996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c1c8d-7338-491b-909d-e4ed8c8f604a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.143282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c1c8d-7338-491b-909d-e4ed8c8f604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.168662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-648c1c8d-7338-491b-909d-e4ed8c8f604a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:02.170725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-648c1c8d-7338-491b-909d-e4ed8c8f604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:02.225294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:02.234957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:02.238041 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1ab1-6420-4da2-940e-a6e7ee8059c6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:02.264297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 201/387] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:02.279410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:02.280361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.280844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.281317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.282759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:02.284390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:02.286585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 187/388] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:02 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:02.294651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c1c8d-7338-491b-909d-e4ed8c8f604a None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:02.296614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:02.411348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13903a29-2be6-4c7f-aa25-d6f9d59c269c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:02.493154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c1c8d-7338-491b-909d-e4ed8c8f604a None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:02.499697 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:02.500646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.501091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.501728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.519986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:02.526954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:02.528015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:02.528818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:02.534589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 188/389] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:02.540977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:02.545961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:02.546874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.547301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.548460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/groups/e7d04ba93ce644bbb9877c033c36c193/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.555534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] RBAC: Authorizing `identity:create_grant(project_id=3dfffa2803c648149b519f9bf3f4e3fd, group_id=e7d04ba93ce644bbb9877c033c36c193, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:02.557250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:02.583448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:02.633795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 202/390] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 1 15:36:02 2022] PUT /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/groups/e7d04ba93ce644bbb9877c033c36c193/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:02.683281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bec73-516b-4d87-852f-299ac87e11cd None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:02.730170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:02.731054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.731483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.731979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.732914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:02.733363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:02.734975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:02.748812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 189/391] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:02.754429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:02.804121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:02.893444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c2ba4-6d1a-44cc-9e51-844e817b6b65 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:02.942301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:02.943206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.943770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.944700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.946105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:02.947735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:02.949922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 203/392] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:02 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:02.955878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:03.042094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:03.070663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a100cd-6c0f-42dd-a7d5-81fdfe980b4a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:03.112989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c928954-dc3c-4a12-acce-d9f9ce5750a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:03.113952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928954-dc3c-4a12-acce-d9f9ce5750a4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.114452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928954-dc3c-4a12-acce-d9f9ce5750a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.114873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928954-dc3c-4a12-acce-d9f9ce5750a4 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.116896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c928954-dc3c-4a12-acce-d9f9ce5750a4 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:03.118553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c928954-dc3c-4a12-acce-d9f9ce5750a4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:03.120734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 190/393] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:02 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:03.129597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:03.201916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce373ad-5bfc-424c-b42a-504a12fe84fa None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.202267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce373ad-5bfc-424c-b42a-504a12fe84fa None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.202477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce373ad-5bfc-424c-b42a-504a12fe84fa None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.203997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 191/394] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:03.210176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f03f5-dd0a-4ae7-b77c-0f47c89ff1e4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.210464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f03f5-dd0a-4ae7-b77c-0f47c89ff1e4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.210743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f03f5-dd0a-4ae7-b77c-0f47c89ff1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.243088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d54f03f5-dd0a-4ae7-b77c-0f47c89ff1e4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:03.245406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d54f03f5-dd0a-4ae7-b77c-0f47c89ff1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:03.279995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8860be7-039d-4c43-a9b8-829e80f9592b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:03.286348 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:03.351220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20095600-43c9-4787-a479-464764cea62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:03.351807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095600-43c9-4787-a479-464764cea62a None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.352090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095600-43c9-4787-a479-464764cea62a None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.352370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095600-43c9-4787-a479-464764cea62a None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/groups/e7d04ba93ce644bbb9877c033c36c193/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.355794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20095600-43c9-4787-a479-464764cea62a None admin] RBAC: Authorizing `identity:create_grant(project_id=3dfffa2803c648149b519f9bf3f4e3fd, group_id=e7d04ba93ce644bbb9877c033c36c193, role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:03.357276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20095600-43c9-4787-a479-464764cea62a None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:03.374668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 192/395] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:03.397063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f03f5-dd0a-4ae7-b77c-0f47c89ff1e4 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:03.438211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 204/396] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 1 15:36:03 2022] PUT /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd/groups/e7d04ba93ce644bbb9877c033c36c193/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:03.486938 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:03.518790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f03f5-dd0a-4ae7-b77c-0f47c89ff1e4 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:03.556418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d0f0-7208-4b6f-ab51-82df73b79445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:03.557091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d0f0-7208-4b6f-ab51-82df73b79445 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.557379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d0f0-7208-4b6f-ab51-82df73b79445 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.557981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d0f0-7208-4b6f-ab51-82df73b79445 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.570260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13d0f0-7208-4b6f-ab51-82df73b79445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-8d13d0f0-7208-4b6f-ab51-82df73b79445 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:03.575347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:03.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:03.577057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 193/397] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:03.582832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20095600-43c9-4787-a479-464764cea62a None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:03.698422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad85e7-17b6-4549-bb94-40bcd2ef342b None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.698721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad85e7-17b6-4549-bb94-40bcd2ef342b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.698906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad85e7-17b6-4549-bb94-40bcd2ef342b None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.700275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 194/398] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:03.706516 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730eca-1016-4a18-97e0-f2dfb7e6ea72 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.706873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730eca-1016-4a18-97e0-f2dfb7e6ea72 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.707067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730eca-1016-4a18-97e0-f2dfb7e6ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.721555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20095600-43c9-4787-a479-464764cea62a None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:03.741597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8b730eca-1016-4a18-97e0-f2dfb7e6ea72 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:03.742874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8b730eca-1016-4a18-97e0-f2dfb7e6ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:03.795953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:03.796621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.796888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.797166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.798913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:03.798913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:03.800582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:03.813661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 205/399] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:03.819008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:03.859217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 195/400] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:03.861920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:03.885550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730eca-1016-4a18-97e0-f2dfb7e6ea72 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:03.954029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275f32-57c6-428b-88fc-c769615b3469 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:03.996282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:03.997384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.997873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.998321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.999710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:04.001166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:04.002842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:04.005446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 206/401] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:03 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:04.011709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:04.099369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730eca-1016-4a18-97e0-f2dfb7e6ea72 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:04.173929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:04.174966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.175475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.175960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.191731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:04.198116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:04.199054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:04.199848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:04.203398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:04.204981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 196/402] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:04.211906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4907a-e75f-4c2f-a5a0-241b3519411e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:04.213235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:04.255617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:04.256840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.257126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.257406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.259468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:04.260960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:04.273665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 207/403] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:04 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:04.292392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:04.432115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b834b-559b-413c-8746-ea1b43bb4e16 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:04.435892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d32d9a-15d6-4ddb-9acb-fd5105bc0f2a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:04.485579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:04.486168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.486448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.486727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44/groups/e7d04ba93ce644bbb9877c033c36c193/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.490180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] RBAC: Authorizing `identity:create_grant(project_id=6511d05de70544bfb533be84d6340a44, group_id=e7d04ba93ce644bbb9877c033c36c193, role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:04.492216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:04.501887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:04.511122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:04.511759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.512054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.512339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.517173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] RBAC: Adding query filter params (name=member) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:04.517173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:04.517173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:04.524604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 197/404] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:36:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:04.531278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:04.639884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d159c-21e4-41a2-b543-241479e2c99c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:04.667654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 208/405] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 1 15:36:04 2022] PUT /identity/v3/projects/6511d05de70544bfb533be84d6340a44/groups/e7d04ba93ce644bbb9877c033c36c193/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:36:04.684975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:04.685663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.685953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.686230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.687434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:04.688989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:04.690975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 198/406] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:04 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:04.696538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:04.726263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:04.845958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeabd2-58fc-4054-94a5-a9a1445fd479 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:04.896427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f7f44-1e16-47e8-985f-011432f38f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:04.897147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7f44-1e16-47e8-985f-011432f38f72 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.897436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7f44-1e16-47e8-985f-011432f38f72 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.897760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7f44-1e16-47e8-985f-011432f38f72 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.898972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f7f44-1e16-47e8-985f-011432f38f72 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:04.900450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f7f44-1e16-47e8-985f-011432f38f72 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:04.902356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 209/407] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:04 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:04.908832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:04.950284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1126-b41d-4662-b666-ec450cd41b03 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.950661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1126-b41d-4662-b666-ec450cd41b03 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.950883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1126-b41d-4662-b666-ec450cd41b03 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.952419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 210/408] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:04.957813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29e1f-cadf-4be1-917b-fb4c2a6b89b2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:04.958186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29e1f-cadf-4be1-917b-fb4c2a6b89b2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:04.958355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29e1f-cadf-4be1-917b-fb4c2a6b89b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:04.971370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:04.980773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-78b29e1f-cadf-4be1-917b-fb4c2a6b89b2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:04.982166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-78b29e1f-cadf-4be1-917b-fb4c2a6b89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:05.024629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593976a-0403-4c77-b733-74a6e76bb220 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:05.061618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 211/409] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:05.072245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:05.072947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.073233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.073564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44/groups/e7d04ba93ce644bbb9877c033c36c193/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.076029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6511d05de70544bfb533be84d6340a44, group_id=e7d04ba93ce644bbb9877c033c36c193, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:05.077485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:05.085107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b29e1f-cadf-4be1-917b-fb4c2a6b89b2 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:05.109276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:05.151288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 199/410] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 1 15:36:04 2022] PUT /identity/v3/projects/6511d05de70544bfb533be84d6340a44/groups/e7d04ba93ce644bbb9877c033c36c193/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:05.198808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b29e1f-cadf-4be1-917b-fb4c2a6b89b2 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:05.241939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:05.242613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.242893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.243168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.256644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:05.261882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:05.262834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:05.263759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:05.268656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 212/411] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:05.270152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:05.408173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900c250-eec9-4e08-9f16-60693c865dd5 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:05.426263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:05.469244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:05.469960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.470242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.470571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.471293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:05.471595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:05.473016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:05.487877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 200/412] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:05.491721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:05.605902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:05.618019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36220bb-46b7-4b90-b9f7-6e31f6e4ef57 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:05.654924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94185078-b3fd-4388-b465-ec51fddc14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:05.655566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94185078-b3fd-4388-b465-ec51fddc14d3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.655850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94185078-b3fd-4388-b465-ec51fddc14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.656124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94185078-b3fd-4388-b465-ec51fddc14d3 None admin] PATH_INFO: `/v3/groups/997386dbe3174fa39112da53f779e8fd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.657346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94185078-b3fd-4388-b465-ec51fddc14d3 None admin] RBAC: Authorizing `identity:get_group(group_id=997386dbe3174fa39112da53f779e8fd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:05.659230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94185078-b3fd-4388-b465-ec51fddc14d3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:05.665679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 213/413] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:05 2022] GET /identity/v3/groups/997386dbe3174fa39112da53f779e8fd => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:05.667466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:05.727631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715857a-77a9-45db-af31-c4132ed244b8 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.727966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715857a-77a9-45db-af31-c4132ed244b8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.728190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715857a-77a9-45db-af31-c4132ed244b8 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.729877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 214/414] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:05.735496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f602f2-2913-4345-911f-3327ee972d08 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.736106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f602f2-2913-4345-911f-3327ee972d08 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.736696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f602f2-2913-4345-911f-3327ee972d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.766477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-32f602f2-2913-4345-911f-3327ee972d08 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:05.769576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-32f602f2-2913-4345-911f-3327ee972d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:05.854545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb6748-d6bb-4626-bfd0-89a79abeb7e7 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:05.885285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 215/415] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:05.900888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:05.901889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.902373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.902846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] PATH_INFO: `/v3/projects/0c484252c6e543fcb5b380854c3b730a` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.904210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] RBAC: Authorizing `identity:get_project(project_id=0c484252c6e543fcb5b380854c3b730a)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:05.905900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:05.908076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 201/416] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:05 2022] GET /identity/v3/projects/0c484252c6e543fcb5b380854c3b730a => generated 344 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:05.917143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f602f2-2913-4345-911f-3327ee972d08 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:05.923803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:05.978367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:06.025955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:06.050183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2bc36-6227-4fd2-9aff-261c1f1d609a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:06.070810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f602f2-2913-4345-911f-3327ee972d08 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:06.101872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:06.102784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.103302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.103733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:06.123077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:06.129706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:06.130789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:06.132147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:06.136701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:06.137603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.138033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.138456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] PATH_INFO: `/v3/projects/0c484252c6e543fcb5b380854c3b730a/groups/997386dbe3174fa39112da53f779e8fd/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:06.141865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c484252c6e543fcb5b380854c3b730a, group_id=997386dbe3174fa39112da53f779e8fd, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:06.143552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:06.143710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 202/417] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:06.147722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:06.238327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 216/418] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 1 15:36:05 2022] PUT /identity/v3/projects/0c484252c6e543fcb5b380854c3b730a/groups/997386dbe3174fa39112da53f779e8fd/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:06.281792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da83bb-c2d7-4cf3-81f7-72164f03680a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:06.301924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:06.325544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bb881-bc2d-419e-93f9-4aab172bd823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:06.326460 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb881-bc2d-419e-93f9-4aab172bd823 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.326766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb881-bc2d-419e-93f9-4aab172bd823 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.327048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb881-bc2d-419e-93f9-4aab172bd823 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:06.330962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bb881-bc2d-419e-93f9-4aab172bd823 None admin] RBAC: Adding query filter params (name=member) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:06.330962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bb881-bc2d-419e-93f9-4aab172bd823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:06.330962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bb881-bc2d-419e-93f9-4aab172bd823 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:06.343225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 203/419] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:36:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:06.349145 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:06.490158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d989a-07a8-4cc5-bdcc-d90d294b8bef None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.490859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d989a-07a8-4cc5-bdcc-d90d294b8bef None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.491141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d989a-07a8-4cc5-bdcc-d90d294b8bef None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:06.492757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 204/420] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:06.498190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5419ba-9dfe-44c2-97dc-ca13b61787f9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.498491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5419ba-9dfe-44c2-97dc-ca13b61787f9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.498755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5419ba-9dfe-44c2-97dc-ca13b61787f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:06.509666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7af92-45a2-4681-8022-15062332aef6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:06.526447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ec5419ba-9dfe-44c2-97dc-ca13b61787f9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:06.527663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ec5419ba-9dfe-44c2-97dc-ca13b61787f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:06.562441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:06.563067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.563352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.563875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:06.574239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:06.613920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 205/421] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:06.629753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5419ba-9dfe-44c2-97dc-ca13b61787f9 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:06.644725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:06.647233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:06.745061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:06.755193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5419ba-9dfe-44c2-97dc-ca13b61787f9 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:06.764710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 217/422] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:06.776061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:06.804543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:06.805223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.805506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.805810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:06.821554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:06.824814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:06.825742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:06.826526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 206/423] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:06.834742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:06.866500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:06.951710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db7400-c616-4d87-a113-22fa66d96804 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:06.971543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6053ec-14c0-4014-b522-4de83e4f1ba3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:06.997632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:06.998615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:06.999107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:06.999579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.000509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:07.001014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:07.002653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:07.015459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:07.016109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.016392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.016670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.017923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:07.019570 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:07.021461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 218/424] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:06 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:07.027603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 207/425] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:07.029066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:07.038759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:07.076582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:07.138473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420120d-d213-4984-bb35-34ab367f47c0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:07.146735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:07.200579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:07.201873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.202385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.202857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.205151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ab936-d6d4-41b2-bc5d-4e67d3e5541a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:07.206103 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:07.207795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:07.215605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 219/426] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:07 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:07.216730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:07.243025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:07.243654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.244084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.244375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.371634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:07.373692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:07.408505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:07.425320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f4789-f0d8-4a9c-94b9-81a18a215840 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:07.498776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7ed84-9e9d-476d-96b9-c48d3f3a0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:07.499434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ed84-9e9d-476d-96b9-c48d3f3a0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.499677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ed84-9e9d-476d-96b9-c48d3f3a0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.499951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ed84-9e9d-476d-96b9-c48d3f3a0ae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.500740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7ed84-9e9d-476d-96b9-c48d3f3a0ae1 None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:07.501047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7ed84-9e9d-476d-96b9-c48d3f3a0ae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:07.502588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7ed84-9e9d-476d-96b9-c48d3f3a0ae1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:07.517546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 220/427] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:07 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=da9b6fc593c747e48d031adf8b20978d => generated 611 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:07.517546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d500db-bffb-4410-b38b-0282d3eec8dd None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.517546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d500db-bffb-4410-b38b-0282d3eec8dd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.517546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d500db-bffb-4410-b38b-0282d3eec8dd None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.517546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 221/428] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:07.531722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5586-ce5a-4aef-8c26-62d1f17a08be None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.532032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5586-ce5a-4aef-8c26-62d1f17a08be None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.532397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5586-ce5a-4aef-8c26-62d1f17a08be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.566846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-73fa5586-ce5a-4aef-8c26-62d1f17a08be None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:07.567965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-73fa5586-ce5a-4aef-8c26-62d1f17a08be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:07.593341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 208/429] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:07.600490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:07.666237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:07.755173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 222/430] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:07.797988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5586-ce5a-4aef-8c26-62d1f17a08be None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:07.827397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef8200-0f2b-4a82-80fb-30a1eb1916b9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:07.857215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:07.889146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5807bb-8dd4-4458-a8d2-446d189ccdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:07.890754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5807bb-8dd4-4458-a8d2-446d189ccdf8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.892030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5807bb-8dd4-4458-a8d2-446d189ccdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.892457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5807bb-8dd4-4458-a8d2-446d189ccdf8 None admin] PATH_INFO: `/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.894513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5807bb-8dd4-4458-a8d2-446d189ccdf8 None admin] RBAC: Authorizing `identity:get_project(project_id=3dfffa2803c648149b519f9bf3f4e3fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:07.897672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5807bb-8dd4-4458-a8d2-446d189ccdf8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:07.901015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 209/431] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:07 2022] GET /identity/v3/projects/3dfffa2803c648149b519f9bf3f4e3fd => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:07.903112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997dd5-6d5a-4a79-9d3e-2577c1fb7b8c None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:07.903560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997dd5-6d5a-4a79-9d3e-2577c1fb7b8c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:07.903975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997dd5-6d5a-4a79-9d3e-2577c1fb7b8c None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:07.906423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 210/432] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:07.909545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997dd5-6d5a-4a79-9d3e-2577c1fb7b8c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:07.962017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5586-ce5a-4aef-8c26-62d1f17a08be None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.004993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed8431-d19e-41b7-a16e-eedd109f3159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.005767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8431-d19e-41b7-a16e-eedd109f3159 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.006620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8431-d19e-41b7-a16e-eedd109f3159 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.006904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8431-d19e-41b7-a16e-eedd109f3159 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.020808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed8431-d19e-41b7-a16e-eedd109f3159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-70ed8431-d19e-41b7-a16e-eedd109f3159 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:08.025913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:08.026834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:08.027876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 223/433] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:08.028629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7adf2a-ab1a-4ee6-8e57-521a7a9156c7 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.029382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7adf2a-ab1a-4ee6-8e57-521a7a9156c7 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.029382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7adf2a-ab1a-4ee6-8e57-521a7a9156c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.054617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-dd7adf2a-ab1a-4ee6-8e57-521a7a9156c7 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:08.055931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-dd7adf2a-ab1a-4ee6-8e57-521a7a9156c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:08.074752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997dd5-6d5a-4a79-9d3e-2577c1fb7b8c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.086004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.119198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.119882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.120146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.120432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.121681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:08.123142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:08.124933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 211/434] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:07 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:08.130424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.149759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 224/435] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:08.150960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7adf2a-ab1a-4ee6-8e57-521a7a9156c7 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.192227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.245345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528907b-bc3f-4a6e-a0a8-04a10572a64c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.272432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7adf2a-ab1a-4ee6-8e57-521a7a9156c7 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.291199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.291199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.291199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.291199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.291601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:08.291601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:08.292660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:08.306637 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 212/436] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:08.306637 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.317818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.319094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.319378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.319652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.320450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:08.320758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:08.322236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:08.337635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 225/437] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=3dfffa2803c648149b519f9bf3f4e3fd&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:08.337635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.369044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.445114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd78138-c19d-4393-a7a1-b598409e5885 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.477900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.481470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a1e6b-b35b-4a12-894f-899aafc31caf None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.498493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.501838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.501838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.501838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.513404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:08.518829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:08.519788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:36:08.520603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:08.523150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 213/438] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:08.530558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.531196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.531476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.531749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.532051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.633404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:08.635817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:08.671477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.684007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1eb85-69c1-49c5-a91f-ccb2994f9134 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.738699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.740093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.740761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.741230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.743136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] RBAC: Adding query filter params (name=member) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:08.743136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:08.747396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:08.762137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 214/439] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:08.768858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.775468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 226/440] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:08.786464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.820499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.913759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25db2-0c3e-4b89-bddb-64403980e65a None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.926990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabef865-613b-4363-84b9-1492e72b7491 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:08.939602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.952498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8bb3-eef3-4677-b9c3-81d69bcb288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.954226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8bb3-eef3-4677-b9c3-81d69bcb288d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.954226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8bb3-eef3-4677-b9c3-81d69bcb288d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.954226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8bb3-eef3-4677-b9c3-81d69bcb288d None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.955032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8bb3-eef3-4677-b9c3-81d69bcb288d None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:08.956541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8bb3-eef3-4677-b9c3-81d69bcb288d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:08.958280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 227/441] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:08.959467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7159-8878-41cd-acfa-fa5432c66af3 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.959756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7159-8878-41cd-acfa-fa5432c66af3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.960039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7159-8878-41cd-acfa-fa5432c66af3 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.965324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 228/442] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:08.965324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c7159-8878-41cd-acfa-fa5432c66af3 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.981067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:08.981832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.982115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.982394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.056714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.058474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.070184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c7159-8878-41cd-acfa-fa5432c66af3 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.094414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.105685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530777e4-7443-4b73-a959-00501a7e1858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.106320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530777e4-7443-4b73-a959-00501a7e1858 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.106606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530777e4-7443-4b73-a959-00501a7e1858 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.106889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530777e4-7443-4b73-a959-00501a7e1858 None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.108608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530777e4-7443-4b73-a959-00501a7e1858 None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.109905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530777e4-7443-4b73-a959-00501a7e1858 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.111551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 229/443] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:09.112810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003c3d1-0806-4844-b3fb-5034b1f3d655 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.113104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003c3d1-0806-4844-b3fb-5034b1f3d655 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.113899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003c3d1-0806-4844-b3fb-5034b1f3d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.133366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8003c3d1-0806-4844-b3fb-5034b1f3d655 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:09.134596 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8003c3d1-0806-4844-b3fb-5034b1f3d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:09.163739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 215/444] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:09.164648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:09.196250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.210725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 230/445] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:09.211814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003c3d1-0806-4844-b3fb-5034b1f3d655 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:09.269878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf49b-469b-45c8-8c97-d847c6909ce1 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.307407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.308301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.308584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.308862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.309699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=6511d05de70544bfb533be84d6340a44) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:09.310012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.311485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.314836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.318307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 216/446] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:09 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:09.318874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:09.327164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003c3d1-0806-4844-b3fb-5034b1f3d655 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.379843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.380520 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.380850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.381129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] PATH_INFO: `/v3/projects/6511d05de70544bfb533be84d6340a44` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.382417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] RBAC: Authorizing `identity:get_project(project_id=6511d05de70544bfb533be84d6340a44)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.383909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.385896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 231/447] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:09 2022] GET /identity/v3/projects/6511d05de70544bfb533be84d6340a44 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:09.391714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:09.444874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2fc5-66d0-4775-93ff-9a7821765d7f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.456065 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.486843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.487512 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.487789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.488074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.499812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:09.503845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c497e-561a-42a6-84f2-e83ae8b4dd25 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:09.505317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:09.506367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:09.507158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 217/448] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:09.512589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:09.555776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.556884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.557383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.558215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] PATH_INFO: `/v3/groups/e7d04ba93ce644bbb9877c033c36c193` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.559779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] RBAC: Authorizing `identity:get_group(group_id=e7d04ba93ce644bbb9877c033c36c193)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.561292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.562962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 232/449] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:09 2022] GET /identity/v3/groups/e7d04ba93ce644bbb9877c033c36c193 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:09.568973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:09.582133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.627460 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fee0f-66a1-47c4-8056-2e5c5a33f720 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.669952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.670586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.670880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.671165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.671888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:09.672202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.673654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.674115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba1ead-b033-4927-b31e-b8d4eb6092a9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.684364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 218/450] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:09.689698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:09.698299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.709649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.710306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.710591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.710865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.711666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] RBAC: Adding query filter params (group.id=e7d04ba93ce644bbb9877c033c36c193, role.id=da9b6fc593c747e48d031adf8b20978d, scope.project.id=6511d05de70544bfb533be84d6340a44) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:09.717127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.717127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.719783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 233/451] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:09 2022] GET /identity/v3/role_assignments?group.id=e7d04ba93ce644bbb9877c033c36c193&scope.project.id=6511d05de70544bfb533be84d6340a44&role.id=da9b6fc593c747e48d031adf8b20978d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:09.797777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bdb9-2de9-43a7-847d-c26dba97f001 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.822012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.833702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.835039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.835324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.835598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.912770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.914298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:10.014989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 219/452] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:10.020810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:10.124658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079690-9f69-4168-99ee-dc20d113d461 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:10.166230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:10.166870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:10.167153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:10.167430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] PATH_INFO: `/v3/projects/0c484252c6e543fcb5b380854c3b730a` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:10.168572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] RBAC: Authorizing `identity:get_project(project_id=0c484252c6e543fcb5b380854c3b730a)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:10.170126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:10.171763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 234/453] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:36:10 2022] GET /identity/v3/projects/0c484252c6e543fcb5b380854c3b730a => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:10.177492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:10.202857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:10.278003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0c3a-4349-4fb0-beba-971463d2a3fb None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:10.311430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f6ef7-61ec-438b-b99d-30043cc11e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:10.312674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6ef7-61ec-438b-b99d-30043cc11e33 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:10.312959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6ef7-61ec-438b-b99d-30043cc11e33 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:10.313237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6ef7-61ec-438b-b99d-30043cc11e33 None admin] PATH_INFO: `/v3/groups/997386dbe3174fa39112da53f779e8fd` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:10.314425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6ef7-61ec-438b-b99d-30043cc11e33 None admin] RBAC: Authorizing `identity:get_group(group_id=997386dbe3174fa39112da53f779e8fd)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:10.315879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6ef7-61ec-438b-b99d-30043cc11e33 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:10.317469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 220/454] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 1 15:36:10 2022] GET /identity/v3/groups/997386dbe3174fa39112da53f779e8fd => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:10.324052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:10.379013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:10.425113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921bc8-b230-4882-a872-29ebad4ef5be None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:10.458676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa68a6-885a-407b-a99c-4a9f73905219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:10.459291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa68a6-885a-407b-a99c-4a9f73905219 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:10.459575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa68a6-885a-407b-a99c-4a9f73905219 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:10.459852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa68a6-885a-407b-a99c-4a9f73905219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:10.460638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa68a6-885a-407b-a99c-4a9f73905219 None admin] RBAC: Adding query filter params (group.id=997386dbe3174fa39112da53f779e8fd, role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=0c484252c6e543fcb5b380854c3b730a) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:10.460952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa68a6-885a-407b-a99c-4a9f73905219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:10.462430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa68a6-885a-407b-a99c-4a9f73905219 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:10.468017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 235/455] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 1 15:36:10 2022] GET /identity/v3/role_assignments?group.id=997386dbe3174fa39112da53f779e8fd&scope.project.id=0c484252c6e543fcb5b380854c3b730a&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:13.081211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3441ba-9e92-41c6-86df-e53a095832c6 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.082352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3441ba-9e92-41c6-86df-e53a095832c6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.082842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3441ba-9e92-41c6-86df-e53a095832c6 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.084713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 221/456] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:13.091096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b808272-fff8-4445-988d-abda01140ef4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.092104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b808272-fff8-4445-988d-abda01140ef4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.092667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b808272-fff8-4445-988d-abda01140ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.121657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7b808272-fff8-4445-988d-abda01140ef4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:13.122869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7b808272-fff8-4445-988d-abda01140ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:13.204523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 236/457] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:13.248963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3441ba-9e92-41c6-86df-e53a095832c6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:13.312136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5d03-db65-4aea-95f8-ac50f2791054 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.312800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5d03-db65-4aea-95f8-ac50f2791054 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.313479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5d03-db65-4aea-95f8-ac50f2791054 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.315480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 237/458] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:13.320886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e386-0954-4c10-adb7-560521c79d7b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.321399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e386-0954-4c10-adb7-560521c79d7b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.321885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e386-0954-4c10-adb7-560521c79d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.346127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3723e386-0954-4c10-adb7-560521c79d7b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:13.348013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3723e386-0954-4c10-adb7-560521c79d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:13.406043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:13.426434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:13.441732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 238/459] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:13.444710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3441ba-9e92-41c6-86df-e53a095832c6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:13.480138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979de21-cbeb-4bbc-a3d3-82602bd977a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:13.480795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979de21-cbeb-4bbc-a3d3-82602bd977a6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.481986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e386-0954-4c10-adb7-560521c79d7b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:13.493976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979de21-cbeb-4bbc-a3d3-82602bd977a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.494320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979de21-cbeb-4bbc-a3d3-82602bd977a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.515688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979de21-cbeb-4bbc-a3d3-82602bd977a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:13.518684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979de21-cbeb-4bbc-a3d3-82602bd977a6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5979de21-cbeb-4bbc-a3d3-82602bd977a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:13.545705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:13.546647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:13.547485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:13.547485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:13.547485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:13.547485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:13.551910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 222/460] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:13.553424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4917-6ce3-416f-b5c9-ac5d1b4b5a7c None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.553743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4917-6ce3-416f-b5c9-ac5d1b4b5a7c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.554020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4917-6ce3-416f-b5c9-ac5d1b4b5a7c None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.555467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 223/461] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:13.557729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4917-6ce3-416f-b5c9-ac5d1b4b5a7c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:13.618967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e386-0954-4c10-adb7-560521c79d7b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:13.663401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6eac5-ebc3-4fa5-9b69-c0d14cf44913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:13.664298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6eac5-ebc3-4fa5-9b69-c0d14cf44913 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.664730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6eac5-ebc3-4fa5-9b69-c0d14cf44913 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.665187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6eac5-ebc3-4fa5-9b69-c0d14cf44913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.678757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6eac5-ebc3-4fa5-9b69-c0d14cf44913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:13.681039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6eac5-ebc3-4fa5-9b69-c0d14cf44913 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:13.683545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4917-6ce3-416f-b5c9-ac5d1b4b5a7c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-7ea6eac5-ebc3-4fa5-9b69-c0d14cf44913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:13.701134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:13.702228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:13.703289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:13.703289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:13.703289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:13.703289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:13.705330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 239/462] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:13.707208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0827c-662b-48d0-8fce-ae1c338e3e8c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.707655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0827c-662b-48d0-8fce-ae1c338e3e8c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.708105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0827c-662b-48d0-8fce-ae1c338e3e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.722688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:13.723403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.723892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.724376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.725388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:13.725898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:13.727467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:13.731182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-09d0827c-662b-48d0-8fce-ae1c338e3e8c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:13.732381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-09d0827c-662b-48d0-8fce-ae1c338e3e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:13.745767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 224/463] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:13.746895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:13.750213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:13.763704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:13.807312 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 240/464] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:13.808438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0827c-662b-48d0-8fce-ae1c338e3e8c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:13.865968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb0c65-14bf-46ab-8768-00e9107ac5c4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:13.903139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585dd6-98e5-4df6-823f-b468e8966117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:13.903687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585dd6-98e5-4df6-823f-b468e8966117 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.903975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585dd6-98e5-4df6-823f-b468e8966117 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.904254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585dd6-98e5-4df6-823f-b468e8966117 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.905315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585dd6-98e5-4df6-823f-b468e8966117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:13.905658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585dd6-98e5-4df6-823f-b468e8966117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:13.907381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585dd6-98e5-4df6-823f-b468e8966117 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:13.923273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 225/465] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:13.923273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f1347-e069-4500-827b-5e3072ea9643 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.923273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f1347-e069-4500-827b-5e3072ea9643 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.923273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f1347-e069-4500-827b-5e3072ea9643 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.923273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 226/466] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:13.923273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f1347-e069-4500-827b-5e3072ea9643 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:13.935271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0827c-662b-48d0-8fce-ae1c338e3e8c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:13.972053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:13.972682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.972990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.973267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.973976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:13.975458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:13.991812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:14.030645 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f1347-e069-4500-827b-5e3072ea9643 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:14.064874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c167f-6a21-4580-9146-b185ba20a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:14.065588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c167f-6a21-4580-9146-b185ba20a357 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.065918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c167f-6a21-4580-9146-b185ba20a357 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.066317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c167f-6a21-4580-9146-b185ba20a357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.077453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c167f-6a21-4580-9146-b185ba20a357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:14.078957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c167f-6a21-4580-9146-b185ba20a357 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:14.093954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 241/467] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:36:13 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:14.093954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-536c167f-6a21-4580-9146-b185ba20a357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:14.108076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:14.109325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:14.110209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:14.110209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:14.110209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:14.110209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:14.112144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 227/468] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:14.114222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb9d51-c370-4689-991b-336e52f2c6e4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.114757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb9d51-c370-4689-991b-336e52f2c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.115048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb9d51-c370-4689-991b-336e52f2c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.128433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:14.140274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-39fb9d51-c370-4689-991b-336e52f2c6e4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:14.141540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-39fb9d51-c370-4689-991b-336e52f2c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:14.233872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 228/469] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:14.233872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb9d51-c370-4689-991b-336e52f2c6e4 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:14.248113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ea44-3d07-489a-924b-86062e9f0c47 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:14.310411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8bdf7-7024-4768-adc0-e14b16cacb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:14.311044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8bdf7-7024-4768-adc0-e14b16cacb14 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.311337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8bdf7-7024-4768-adc0-e14b16cacb14 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.311621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8bdf7-7024-4768-adc0-e14b16cacb14 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.312459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:14.312599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8bdf7-7024-4768-adc0-e14b16cacb14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:14.315529 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8bdf7-7024-4768-adc0-e14b16cacb14 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:14.385672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb9d51-c370-4689-991b-336e52f2c6e4 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:14.427125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003282-41af-49c2-9ce1-2f33b5f6a6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:14.427782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003282-41af-49c2-9ce1-2f33b5f6a6f8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.428063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003282-41af-49c2-9ce1-2f33b5f6a6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.428337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003282-41af-49c2-9ce1-2f33b5f6a6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.429053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003282-41af-49c2-9ce1-2f33b5f6a6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:14.429338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003282-41af-49c2-9ce1-2f33b5f6a6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:14.430882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003282-41af-49c2-9ce1-2f33b5f6a6f8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:14.438969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 242/470] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:36:14 2022] POST /identity/v3/users => generated 248 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:14.441339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c848ab-4098-4be5-8e52-fb1a7a056fba None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.442019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c848ab-4098-4be5-8e52-fb1a7a056fba None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.442696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c848ab-4098-4be5-8e52-fb1a7a056fba None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.446311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 243/471] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:14.448112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c848ab-4098-4be5-8e52-fb1a7a056fba None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:14.453866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 229/472] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:14.453866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c41c9-5130-479d-a86c-7443e201dd77 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.453866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c41c9-5130-479d-a86c-7443e201dd77 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.453866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c41c9-5130-479d-a86c-7443e201dd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.478370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c39c41c9-5130-479d-a86c-7443e201dd77 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:14.479943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c39c41c9-5130-479d-a86c-7443e201dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:14.583351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:14.587324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 230/473] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:14.588756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c41c9-5130-479d-a86c-7443e201dd77 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:14.632925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:14.638288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c848ab-4098-4be5-8e52-fb1a7a056fba None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:14.678480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:14.678985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.679344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.679693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.695394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:14.696930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:14.715656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:14.719691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:14.720560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:14.720560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:14.720560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:14.720560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:14.720560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 244/474] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:14.720560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:14.744703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c41c9-5130-479d-a86c-7443e201dd77 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:14.811947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:14.812657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.812876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.813155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.813883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:14.815922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:14.842069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97f1fd-e09a-45b3-99e5-47b3e09905d0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:14.872811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:14.883388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:14.884028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:14.884360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:14.884689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:14.885552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:14.887010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:14.928402 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 231/475] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:36:14 2022] POST /identity/v3/users => generated 248 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:14.930286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:14.950776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.sql.core [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:36:14.950776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 15:36:14.950776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [parameters: {'id': '4b508cb770de41a6908615ad6b5d5063', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 15:36:14.950776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92565) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result.read() Aug 01 15:36:15.011841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:36:15.013465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application yield resource Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise self.value Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application session.commit() Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:36:15.015335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:36:15.017141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:36:15.018983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result.read() Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:36:15.020593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [parameters: {'id': '4b508cb770de41a6908615ad6b5d5063', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:15.026429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 15:36:15.028831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:15.035415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 245/476] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 1 15:36:14 2022] POST /identity/v3/roles => generated 144 bytes in 308 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:15.035415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:15.170223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:15.191083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f15e-ce4f-4470-95e2-f1bd42654387 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:15.241646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6be786-6836-4dcf-9321-95b3591ad486 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:15.273272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:15.275060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:15.275930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:15.277267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:15.278707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:15.279146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:15.281326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:15.299671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:15.300557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:15.301023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:15.301477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:15.305436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 232/477] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:15.311991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:15.315435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:15.321783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:15.322729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:36:15.323531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:15.325886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 246/478] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:15.332332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:15.410697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:15.472391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c975e-033e-4cc5-8ad9-f2fd35bf93cb None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:15.483965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55a4f-cc7c-4a0c-a893-315776d654af None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:15.524066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4152-5f32-455e-9e3b-2598fcff0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:15.524809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4152-5f32-455e-9e3b-2598fcff0338 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:15.525086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4152-5f32-455e-9e3b-2598fcff0338 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:15.525367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4152-5f32-455e-9e3b-2598fcff0338 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:15.526093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4152-5f32-455e-9e3b-2598fcff0338 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:15.526845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecea0a2-c317-4319-b2c2-0e7e3bc70d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:15.527539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecea0a2-c317-4319-b2c2-0e7e3bc70d18 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:15.527640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4152-5f32-455e-9e3b-2598fcff0338 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:15.527825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecea0a2-c317-4319-b2c2-0e7e3bc70d18 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:15.528101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecea0a2-c317-4319-b2c2-0e7e3bc70d18 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:15.528916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecea0a2-c317-4319-b2c2-0e7e3bc70d18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:15.529224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecea0a2-c317-4319-b2c2-0e7e3bc70d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:15.530697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecea0a2-c317-4319-b2c2-0e7e3bc70d18 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:15.542715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 247/479] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:15.647796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 233/480] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:36:15 2022] POST /identity/v3/users => generated 249 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:16.503467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd1a0-0487-4567-8321-9ace2f198870 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:16.504008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd1a0-0487-4567-8321-9ace2f198870 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:16.504008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd1a0-0487-4567-8321-9ace2f198870 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:16.506320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 248/481] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:16.511422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e771-e4f8-4c97-83dd-91308d3bcadb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:16.511896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e771-e4f8-4c97-83dd-91308d3bcadb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:16.511994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e771-e4f8-4c97-83dd-91308d3bcadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:16.528248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:16.538233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-9d38e771-e4f8-4c97-83dd-91308d3bcadb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:16.539456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9d38e771-e4f8-4c97-83dd-91308d3bcadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:16.627760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 234/482] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:16.676370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbd1a0-0487-4567-8321-9ace2f198870 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:16.819250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbd1a0-0487-4567-8321-9ace2f198870 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:16.841714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:16.873739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:16.874493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:16.874783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:16.875064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:16.875881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a413ce-4305-4254-a8cf-73b133b33bee None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:16.876171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a413ce-4305-4254-a8cf-73b133b33bee None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:16.876444 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a413ce-4305-4254-a8cf-73b133b33bee None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:16.879193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 235/483] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:16.883389 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9800b49-b1f5-4978-a779-61c7cc1ac99e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:16.883673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9800b49-b1f5-4978-a779-61c7cc1ac99e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:16.883956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9800b49-b1f5-4978-a779-61c7cc1ac99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:16.892922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:16.898083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:16.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:16.899789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 249/484] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:16.905047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:16.912960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b9800b49-b1f5-4978-a779-61c7cc1ac99e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:16.914199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b9800b49-b1f5-4978-a779-61c7cc1ac99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:17.074537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 236/485] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:17.115829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c1d4e-56ea-4330-a36b-f8d1913e00fb None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:17.122190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9800b49-b1f5-4978-a779-61c7cc1ac99e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:17.213888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:17.214705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.215121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.215968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.217092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:17.217594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:17.220036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:17.246875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 250/486] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:17.252438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:17.319454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:17.364918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:17.392300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9800b49-b1f5-4978-a779-61c7cc1ac99e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:17.429921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:17.430568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.430896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.431168 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.444822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:17.457847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:17.459356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:17.460166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:17.461312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 237/487] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:17.464542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d1f8e-0289-4634-8fdf-09ae70686493 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:17.487211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:17.546313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:17.547595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.548015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.548420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.572428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:17.574941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:17.605127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:17.606240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:17.607306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:17.607306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:17.607306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:17.607306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:17.614014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 251/488] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:17.618278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:17.700797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27219ea-cd73-4603-917e-ea90a65c2b0e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:17.748818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:17.766185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:17.767065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.767499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.775196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.775196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:17.775196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:17.775196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:17.785914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:17.789814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 238/489] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:17.791958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:17.813660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aaba-3f82-4937-a878-b7f2da442cb8 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:17.877133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:17.878038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.878496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.878921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.879776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:17.880268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:17.882798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:17.909003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 252/490] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:17.913671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:17.983224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96399b-121e-4d2a-a1f7-c089c1bd05f3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.038469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb7687-56ff-4fbf-8de6-4e84602cdcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.039206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7687-56ff-4fbf-8de6-4e84602cdcd8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.039406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7687-56ff-4fbf-8de6-4e84602cdcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.039687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7687-56ff-4fbf-8de6-4e84602cdcd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.051784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb7687-56ff-4fbf-8de6-4e84602cdcd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.053373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb7687-56ff-4fbf-8de6-4e84602cdcd8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-70bb7687-56ff-4fbf-8de6-4e84602cdcd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:18.070466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:18.071399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:18.072247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:18.072247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:18.072247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:18.072247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:18.072247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 239/491] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:18.073157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f394-687f-49dd-97ec-2917e5c29233 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.073157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f394-687f-49dd-97ec-2917e5c29233 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.073401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f394-687f-49dd-97ec-2917e5c29233 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.077613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424889f-982d-4d51-8f7b-786274252594 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.078230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 240/492] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:18.080184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebadf3-de73-416d-8aa5-5287dea24247 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.081899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebadf3-de73-416d-8aa5-5287dea24247 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.082367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebadf3-de73-416d-8aa5-5287dea24247 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.084857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 241/493] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:18.085849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebadf3-de73-416d-8aa5-5287dea24247 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.117925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157112a6-0587-41f0-91df-ad10aa4cf6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.118684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157112a6-0587-41f0-91df-ad10aa4cf6d9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.118974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157112a6-0587-41f0-91df-ad10aa4cf6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.119245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157112a6-0587-41f0-91df-ad10aa4cf6d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.126783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157112a6-0587-41f0-91df-ad10aa4cf6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.128505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157112a6-0587-41f0-91df-ad10aa4cf6d9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.136244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-157112a6-0587-41f0-91df-ad10aa4cf6d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:18.143433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:18.148022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 253/494] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328a9f-b2fb-44f7-bd95-53e932f3569c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.148950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328a9f-b2fb-44f7-bd95-53e932f3569c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.150218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328a9f-b2fb-44f7-bd95-53e932f3569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.162504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.170453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ec328a9f-b2fb-44f7-bd95-53e932f3569c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:18.171689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ec328a9f-b2fb-44f7-bd95-53e932f3569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:18.206188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebadf3-de73-416d-8aa5-5287dea24247 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.253542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 254/495] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:18.253542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d95ea-cf95-4a93-99df-8c03cab2fdb6 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.253542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d95ea-cf95-4a93-99df-8c03cab2fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.253542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d95ea-cf95-4a93-99df-8c03cab2fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.257506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.258299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.258834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.258940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.259646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:18.259949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.261346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.275417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 242/496] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:18.276108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.281327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-055d95ea-cf95-4a93-99df-8c03cab2fdb6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:18.282671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-055d95ea-cf95-4a93-99df-8c03cab2fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:18.356115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 255/497] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:18.356969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d95ea-cf95-4a93-99df-8c03cab2fdb6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.394758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.399417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d341a2-a570-49b8-83f5-31c3c4343420 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.436364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.436981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.437683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.437973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.438246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.439033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:18.439405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.440834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.472160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d95ea-cf95-4a93-99df-8c03cab2fdb6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.477952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 243/498] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:18.478787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.509328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.510004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.510289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.510563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.520425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:18.525370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:18.526512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 256/499] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:18.527374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.588614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef7b0-4390-476b-b8e8-f41e841fb9ac None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.617848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3564-ba57-48db-87cf-88d6c49b3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.618497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3564-ba57-48db-87cf-88d6c49b3d0b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.618785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3564-ba57-48db-87cf-88d6c49b3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.619067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3564-ba57-48db-87cf-88d6c49b3d0b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.626619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3564-ba57-48db-87cf-88d6c49b3d0b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.628791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3564-ba57-48db-87cf-88d6c49b3d0b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.637305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8c7fb-63e1-4d87-b87c-df34568ab283 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-7f3e3564-ba57-48db-87cf-88d6c49b3d0b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:18.642294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:18.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:18.644130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 244/500] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:18.644911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a9eb-29fc-45ce-9eb9-4d08859b8644 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.645084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a9eb-29fc-45ce-9eb9-4d08859b8644 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.645360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a9eb-29fc-45ce-9eb9-4d08859b8644 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.646649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 245/501] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:18.647337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6a9eb-29fc-45ce-9eb9-4d08859b8644 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.667371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.668584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.677405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.678109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.680344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.680344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.689417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.690959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:18.705920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:18.709108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:18.710219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:18.710219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:18.710219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:18.710219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:18.710219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 257/502] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:18.710219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.757957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6a9eb-29fc-45ce-9eb9-4d08859b8644 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.793992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ea9e2-6025-4546-987e-4c4f8c5f030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.794614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea9e2-6025-4546-987e-4c4f8c5f030e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.794897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea9e2-6025-4546-987e-4c4f8c5f030e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.795170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea9e2-6025-4546-987e-4c4f8c5f030e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.817080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fb87d-0b73-4888-9463-287d466e46ec None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.854129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:18.854667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.854955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.855232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:18.855957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:18.856261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.857679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.866617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ea9e2-6025-4546-987e-4c4f8c5f030e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:18.866788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 258/503] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:18.867457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:18.868217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ea9e2-6025-4546-987e-4c4f8c5f030e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:18.893149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.926821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:18.991405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815aaf-ca4c-4dae-82db-3d1d114fe33b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:18.995863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 246/504] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:18.997129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a05500-76d9-4f96-ade4-cbd0df1aeff1 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:18.997417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a05500-76d9-4f96-ade4-cbd0df1aeff1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:18.997721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a05500-76d9-4f96-ade4-cbd0df1aeff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.014945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-70a05500-76d9-4f96-ade4-cbd0df1aeff1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:19.016165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-70a05500-76d9-4f96-ade4-cbd0df1aeff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:19.026971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.027593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.027880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.028157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.028953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:19.029264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.030737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.084609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 259/505] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 1 15:36:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:19.086053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.103765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 247/506] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:19.104875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a05500-76d9-4f96-ade4-cbd0df1aeff1 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.153891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.200401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.204521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6314b13-fd78-43fb-babc-c4d68b0233b6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.205401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a05500-76d9-4f96-ade4-cbd0df1aeff1 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.239374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.239996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.240338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.240562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.240965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.241256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:19.241591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.241693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.241980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.242261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.242987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.253457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.254964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.258629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 260/507] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:19.259772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:19.271998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:19.272930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:19.273949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:19.273949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:19.273949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:19.273949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:19.273949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 248/508] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:19.274752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.384472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e442fa9-0c7a-4a21-9e7a-761d5e68d582 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.393256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.397010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6908e-e2b1-422c-9093-959a031edc60 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.419905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.420548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.420836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.421116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.432511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.433130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.433409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.433717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.434846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.436341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:19.451009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:19.452038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:19.453070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:19.453070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:19.453070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:19.453070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:19.453070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 261/509] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:19.453365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.469897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.507490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.508973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.556765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771b72f-e8ce-4e9d-a0f5-bee8d54beca4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.591589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.592234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.592524 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.592808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.603404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:19.606578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:19.608883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:19.609917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 262/510] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:19.619834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.620621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 249/511] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:19.620621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.688366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.720379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbabbb-6636-4090-997e-ccf7718f2b10 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.726351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c2b65-ce39-4233-8b35-f15574708b2d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.752844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.753462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.753775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.754059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.754746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.756727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.760106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.760723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.761006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.761285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.762006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:19.762314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.763719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.775455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 250/512] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:19.776270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.832212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 263/513] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:36:19 2022] POST /identity/v3/users => generated 247 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:19.833045 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.842118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.886353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f572c4a-2f4e-41bf-ad16-9d800385c653 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.924780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.925424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.925737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.926144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.926858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:19.927217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:19.928696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:19.947466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 251/514] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:19.947466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:19.960376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6be620-a079-4b05-ae7d-ad40eb4f0259 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:19.987300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:19.997876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:19.998954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:19.998954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:19.999120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:19.999777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:20.000141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.001954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.018149 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 264/515] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:20.019413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.068983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717517d9-d138-4622-a25a-87dfb8a65426 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.091639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:20.107226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.107873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.108158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.108435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.119352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.120812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.128084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af961-f790-4f19-af1a-2281169cfbd0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:20.136018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:20.136870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:20.137760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:20.137760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:20.137760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:20.137760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:20.142219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 252/516] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:20.143474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.166039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.166695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.166998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.167261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] PATH_INFO: `/v3/users/glance` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.174460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.175949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:20.189571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:20.190510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:20.191395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 265/517] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:20.191938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.243540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:20.257130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262ac7f-e470-4355-a8c1-8d8ca87c7e96 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.299616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.300271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.300557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.300833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.301654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0473c-5866-49b7-a029-de7874a4a25d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.308899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.310542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:20.324235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:20.325122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 253/518] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:20.326480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.344873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.345608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.345906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.346105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.357686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.360032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.362422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:20.377610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:20.378558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:20.379367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:20.379367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:20.379367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:20.379367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:20.383536 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 266/519] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:20.384450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.449885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c6340-48a2-45a9-84bf-1365c760a1a3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.488978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.490344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.490626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.490896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.491590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:20.491903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.493285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.499580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:20.504205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4b136-7e4a-491b-b828-2c26857d3b76 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.507011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 254/520] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:20.507853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.549613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.550604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.551187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.551666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.553403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:20.554104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.555576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.574550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 267/521] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:20.580032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.616075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:20.625844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11530b-d033-442c-a930-7563803c3250 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.680102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.681170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.681847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.682455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.683882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:20.684812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.687276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.726991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 255/522] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:20.726991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.727301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b433aa-2e96-4015-aea1-1aa28c49eafa None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.773036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.773696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.774465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.774755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.775491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:20.775859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.777967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.794903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 268/523] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:20.794903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.815983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:20.851509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c4dd-6cc8-4f83-9589-df053b041075 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.896104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.896767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.897215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.898083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:20.908677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:20.909039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1efc-7172-4956-8767-ffb220c75c69 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:20.910180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:20.921936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:20.923475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:20.925346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:20.929453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 256/524] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:20.930668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:20.949272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:20.953197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:20.954097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:20.954484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:20.954858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.033676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.035085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.055178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:21.055375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285b69-54ed-432e-8c20-0237e4ff0a85 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:21.094868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:21.095509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:21.095794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:21.096071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.096871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=784ac400fc5643a589d79d0314ee4a19) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:21.097181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.099212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.113855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 257/525] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/role_assignments?user.id=784ac400fc5643a589d79d0314ee4a19&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:21.113855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.163113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 269/526] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:21.163905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.229426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:21.270584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5165d-6d10-45d1-9bbf-d220f543e89e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:21.299667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451ec34-5df5-4674-ad4d-c7ba8b92a6e1 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:21.320842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:21.321660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:21.322014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:21.322357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.331113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:21.333872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.335554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:21.348085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:21.350113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:36:21.351221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:21.355164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:21.356012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 258/527] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:21.356250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:21.356755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:21.356952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.357458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.358435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:21.358897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.361893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.385614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 270/528] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:21.386779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.518802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484bdf-bb29-4fda-95f4-9667c9043161 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:21.550193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998c30b-d69d-4592-be7b-071b12856180 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:21.563433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:21.565130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:21.565591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:21.566039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.569872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:21.581876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.584565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.607919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:21.608844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:21.609993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:21.610482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:21.611127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:21.612106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:21.613116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:21.613116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:21.613116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:21.613116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:21.613870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:21.614363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.620141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 259/529] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:21.620141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.620918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.646320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 271/530] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:21.647206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.694523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:21.744565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996330-959d-4fd9-830f-9e7c7bd5ceb0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:21.781945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d4344-227c-4e59-bc30-29280f1b8b3b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:21.787659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:21.788514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:21.788978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:21.789434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.790461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=6bdef4163b5048ed9c9815683a44f019) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:21.791589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.793785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.803554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 260/531] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/role_assignments?user.id=6bdef4163b5048ed9c9815683a44f019&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:21.804659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.846853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:21.847542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:21.847830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:21.848110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:21.849630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:21.849945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:21.851475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:21.876837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:21.881545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 272/532] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:21.886191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:21.959065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6469-7f46-40f7-874e-699a5dbd65c7 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.009000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.010247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.010539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.010820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.028030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.037454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20d94-b6d0-4e16-8eb6-fc59f1454ad0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.094418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15804a2-d85f-4709-80db-d5a26544e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.095776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15804a2-d85f-4709-80db-d5a26544e973 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.096453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15804a2-d85f-4709-80db-d5a26544e973 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.097107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15804a2-d85f-4709-80db-d5a26544e973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.109719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15804a2-d85f-4709-80db-d5a26544e973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.112649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15804a2-d85f-4709-80db-d5a26544e973 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.128148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.130812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-a15804a2-d85f-4709-80db-d5a26544e973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:22.135326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:22.137116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:22.139091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:22.142476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 273/533] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:22.144894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6b78-ec6d-49ce-9918-a17bfabe1fa0 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.145658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6b78-ec6d-49ce-9918-a17bfabe1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.146324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6b78-ec6d-49ce-9918-a17bfabe1fa0 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.155361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 274/534] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:22.157886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc126a-3c14-441e-bb31-8f1b6899e104 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.158657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc126a-3c14-441e-bb31-8f1b6899e104 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.159296 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc126a-3c14-441e-bb31-8f1b6899e104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.189731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-66fc126a-3c14-441e-bb31-8f1b6899e104 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:22.192003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-66fc126a-3c14-441e-bb31-8f1b6899e104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:22.229963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.294162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 261/535] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:22.295276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.301554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 275/536] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:22.301554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc126a-3c14-441e-bb31-8f1b6899e104 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.418044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.432401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab6096-4c99-461c-96c0-ddf54fdd4de3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.436886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc126a-3c14-441e-bb31-8f1b6899e104 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.473762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784229e9-cc58-491f-b857-19a662214891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.474419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784229e9-cc58-491f-b857-19a662214891 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.474706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784229e9-cc58-491f-b857-19a662214891 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.474989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784229e9-cc58-491f-b857-19a662214891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.479056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.479760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.480112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.480457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.481276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:22.481684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.483670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.486108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784229e9-cc58-491f-b857-19a662214891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.487572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784229e9-cc58-491f-b857-19a662214891 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-784229e9-cc58-491f-b857-19a662214891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:22.504057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:22.505033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:22.506432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:22.506432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:22.506432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:22.506432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:22.506432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 276/537] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:22.506989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 262/538] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:22.511307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784229e9-cc58-491f-b857-19a662214891 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.511471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.526871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.629661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784229e9-cc58-491f-b857-19a662214891 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.649919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4915d3-d256-4608-9d0e-8461bf4d411f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.666851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.667614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.667973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.668381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.677357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.683016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:22.688215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:22.690248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:22.691034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:22.695740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 277/539] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:22.695740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.699639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.701381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.701842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.702263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.703215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=5048d76e4ffb4e12bb76ad3c8e5095ad) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:22.703686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.705276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.718198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 263/540] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/role_assignments?user.id=5048d76e4ffb4e12bb76ad3c8e5095ad&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:22.719628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.865019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9e36-4530-4eac-bde0-5fceaa1fc29b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.907032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.929363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.930373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.930858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.931385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.932563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:22.933068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.934609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c673-a8e2-4de3-8f4c-209eaeccc538 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.936032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.951895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 278/541] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:22.957237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.973610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.973610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.973610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.973610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.974765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:22.975004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.976505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.986322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 264/542] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:22.999925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.035466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:23.128083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81ef52-6d06-4ebd-9492-2e4ab457e638 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.149628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d0691-1769-4b3a-aa4c-3cf3ae5f8011 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.169554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.169554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.169554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.169554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.174539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:23.179301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:23.181037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:23.198499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:23.199403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:23.200232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:23.200232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:23.200232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:23.200232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:23.200232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 265/543] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:23.201551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.202428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.202917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.203385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.206060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.222947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:23.225015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:23.243931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:23.244830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:23.245680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:23.252594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 279/544] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:23.253550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.394750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825e7d-fc1f-400b-b3b6-4fddbf45c2be None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.433301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96df1f2-d74e-4501-98a4-8d7de95e69d6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.453231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de170ec4-2f82-4a0d-9b07-7e51c96c6fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.453924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de170ec4-2f82-4a0d-9b07-7e51c96c6fa4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.454211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de170ec4-2f82-4a0d-9b07-7e51c96c6fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.454533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de170ec4-2f82-4a0d-9b07-7e51c96c6fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.455243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de170ec4-2f82-4a0d-9b07-7e51c96c6fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:23.455643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de170ec4-2f82-4a0d-9b07-7e51c96c6fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:23.457140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:23.457288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de170ec4-2f82-4a0d-9b07-7e51c96c6fa4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:23.485237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 266/545] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:23.485237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f55e-976b-4ec9-85d5-007e710e2db8 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.485237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f55e-976b-4ec9-85d5-007e710e2db8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.485237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f55e-976b-4ec9-85d5-007e710e2db8 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.490626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 267/546] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:23.497295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50f55e-976b-4ec9-85d5-007e710e2db8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.498726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a4ade-7a48-4fc5-8c81-dbc02f7b8800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.499557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4ade-7a48-4fc5-8c81-dbc02f7b8800 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.500031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4ade-7a48-4fc5-8c81-dbc02f7b8800 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.500455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4ade-7a48-4fc5-8c81-dbc02f7b8800 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.501366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4ade-7a48-4fc5-8c81-dbc02f7b8800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:23.502131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4ade-7a48-4fc5-8c81-dbc02f7b8800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:23.506122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4ade-7a48-4fc5-8c81-dbc02f7b8800 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:23.523941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 280/547] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:23.525499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105478c-c329-4e09-b58a-b428e9edb360 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.525981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105478c-c329-4e09-b58a-b428e9edb360 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.526410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105478c-c329-4e09-b58a-b428e9edb360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.546917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c105478c-c329-4e09-b58a-b428e9edb360 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:23.548486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c105478c-c329-4e09-b58a-b428e9edb360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:23.560511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:23.626916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50f55e-976b-4ec9-85d5-007e710e2db8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.635434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 281/548] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:23.636558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105478c-c329-4e09-b58a-b428e9edb360 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.696562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.698831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.698831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.698831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] PATH_INFO: `/v3/users/swift` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.709805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:23.711600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:23.725358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:23.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:23.727884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:23.729192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 268/549] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:23.733632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.766358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105478c-c329-4e09-b58a-b428e9edb360 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.777220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:23.805741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.807263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.807789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.808337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.809347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=90399c6cab2341f1af74d154c819bff9) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:23.809892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:23.811680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:23.819349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 282/550] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:23 2022] GET /identity/v3/role_assignments?user.id=90399c6cab2341f1af74d154c819bff9&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:23.820644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.849499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e3ecb-b6b5-40cb-a4eb-e8a8cb7841fa None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.862283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:23.890908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.891575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.891932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.892212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:23.905375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:23.911817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:23.913233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:23.914101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:23.917743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 269/551] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:23.919902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:23.947856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b319-b9b0-404b-be1f-fb93652ca412 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:23.991121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:23.992236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:23.992725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:23.993217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.001928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:24.002653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:24.004584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:24.038608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829294-7f33-49c5-ad23-10d24c9c7269 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:24.040895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 283/552] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 1 15:36:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:24.048344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.084273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef97e8-4b00-404e-9714-703f30d26682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:24.084987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef97e8-4b00-404e-9714-703f30d26682 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.085274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef97e8-4b00-404e-9714-703f30d26682 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.085601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef97e8-4b00-404e-9714-703f30d26682 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.086336 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef97e8-4b00-404e-9714-703f30d26682 None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:24.086649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef97e8-4b00-404e-9714-703f30d26682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:24.088126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef97e8-4b00-404e-9714-703f30d26682 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:24.102606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 270/553] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:24.102606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32b7fe-1c97-4ce7-959b-3ab06c20214c None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.102606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32b7fe-1c97-4ce7-959b-3ab06c20214c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.102606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32b7fe-1c97-4ce7-959b-3ab06c20214c None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.102606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 271/554] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:24.108319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5d76f-4145-42c0-8844-2658222cf323 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.108608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5d76f-4145-42c0-8844-2658222cf323 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.108888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5d76f-4145-42c0-8844-2658222cf323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.110299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:24.133990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-bdb5d76f-4145-42c0-8844-2658222cf323 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:24.135585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bdb5d76f-4145-42c0-8844-2658222cf323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:24.174484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:24.205406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47158-080a-46aa-9b70-262552765400 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:24.234441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 272/555] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:24.241476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5d76f-4145-42c0-8844-2658222cf323 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.269256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:24.271118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.271612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.272556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.356908 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:24.358516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:24.387147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5d76f-4145-42c0-8844-2658222cf323 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:24.391112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:24.440644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:24.441755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.442804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.443263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.459074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:24.461552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:24.480051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 284/556] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:24.481128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:24.483184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:24.484265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:24.485338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:24.485338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:24.485338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:24.485338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:24.488774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 273/557] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:24.490307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.513097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:24.607381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eaad6-2530-4f36-a8ce-8cd8f52d6f43 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:24.621721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8e59f-aaee-4102-82b7-0b8beeda3283 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:24.653785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:24.662769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:24.663425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.663870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.664241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.678578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:24.685464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:24.687052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:24.688392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:24.691594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 285/558] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:24.693310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.694388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:24.695308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.695826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.696299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.714158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:24.716509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:24.738407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:24.739899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:24.740842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:24.740842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:24.740842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:24.740842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:24.743422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 274/559] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:24.744542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.829036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10646e3-1b0d-4b30-9410-2243eb352df9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:24.831880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:24.877681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c26e90-f41b-40df-8a43-e4c13a6be88d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:24.879068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:24.879963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.880465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.881040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.882290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:24.882808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:24.884523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:24.901759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 286/560] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:24.903095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.917109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:24.917982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:24.918113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:24.918489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:24.919045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:24.919347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:24.921126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:24.936588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 275/561] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:24.937412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:24.973908 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.031496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13d48-0c3a-4855-8ccb-c0bfe57ee903 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.053767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2127e-58a3-4673-8f05-2a2344c99f42 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.075250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.076110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.076398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.076677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.077378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:25.077724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.079169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.092314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 287/562] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:25.093588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.097431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.103385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32587997-7394-40b3-b062-df214e134391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.104053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587997-7394-40b3-b062-df214e134391 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.104338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587997-7394-40b3-b062-df214e134391 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.104623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587997-7394-40b3-b062-df214e134391 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.113541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32587997-7394-40b3-b062-df214e134391 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.115092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32587997-7394-40b3-b062-df214e134391 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-32587997-7394-40b3-b062-df214e134391 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:25.127678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:25.128759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:25.130238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 276/563] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:36:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:25.131438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5c60-85c8-46f6-81c0-42a7cb408437 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.131438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5c60-85c8-46f6-81c0-42a7cb408437 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.131438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5c60-85c8-46f6-81c0-42a7cb408437 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.132819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 277/564] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:25.137570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5c60-85c8-46f6-81c0-42a7cb408437 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.229262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7bfa6-8f81-4747-a6b0-0e506aa80603 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.240881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.260352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5c60-85c8-46f6-81c0-42a7cb408437 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.266323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.266962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.267248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.267571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.284078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.285623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:25.301939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:25.303016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:25.303900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:25.303900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:25.303900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:25.303900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:25.303900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 288/565] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:25.303900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.312214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91256-dd26-4ca7-8129-0a8b0d970777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.312954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91256-dd26-4ca7-8129-0a8b0d970777 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.313341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91256-dd26-4ca7-8129-0a8b0d970777 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.313728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91256-dd26-4ca7-8129-0a8b0d970777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.321542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91256-dd26-4ca7-8129-0a8b0d970777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.323033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91256-dd26-4ca7-8129-0a8b0d970777 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-86c91256-dd26-4ca7-8129-0a8b0d970777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:25.334959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:25.335882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:25.336802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 278/566] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:25.337274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643aa5-8a4b-490c-9d6f-b6993d82a72b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.339266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643aa5-8a4b-490c-9d6f-b6993d82a72b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.339266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643aa5-8a4b-490c-9d6f-b6993d82a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.356832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1c643aa5-8a4b-490c-9d6f-b6993d82a72b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:25.358055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1c643aa5-8a4b-490c-9d6f-b6993d82a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:25.408918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.428077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd156d-805f-4ead-99e7-f54a11b21923 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.445650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 279/567] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:25.445650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643aa5-8a4b-490c-9d6f-b6993d82a72b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.491181 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.491871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.492255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.492630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.493545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:25.493961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.495524 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.518799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 289/568] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:25.518799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.540412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.578140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643aa5-8a4b-490c-9d6f-b6993d82a72b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.616526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.617148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.617435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.617735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.618654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:25.618772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.620121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.621687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa70403-4983-4c73-9488-94d5da187ee8 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.637206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 280/569] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:25.637206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.665382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.666036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.666325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.666607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.667360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:25.667672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.669113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.679297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.682683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 290/570] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:25.683351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.761968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262a12-8c52-4398-96e8-cb37c514f0c5 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.795607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.798218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.798878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.799148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.799422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.810610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:25.816012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:25.816956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:25.818250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:25.818916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d6aab-afac-4c26-9142-85e42807f347 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.819005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 281/571] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:25.819005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.857621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.858270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.858638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.859067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.874610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:25.876095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:25.895759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:25.896717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:25.897649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:25.897649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:25.897649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:25.897649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:25.897649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 291/572] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:25.897649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:25.938126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:25.942988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945528f-22e9-4fb0-9ad5-98efe3aaa030 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:25.985485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:25.986157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:25.986510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:25.986787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:25.996060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.001175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:26.014162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:26.015119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:26.016081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 282/573] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:26.016675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.030918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a296793-0ab4-4a28-8852-7b112211cbd3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.061650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.066768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.067172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.067459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.067736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.069792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=159e2784eaf44126b4e04dacbb328add) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:26.070658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.071717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.077255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 292/574] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:25 2022] GET /identity/v3/role_assignments?user.id=159e2784eaf44126b4e04dacbb328add&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:26.078094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.137605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ded4a-3a8b-477c-b0f9-e8060c9deaf5 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.180007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.180656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.180942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.181221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.182405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:26.182714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.184181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.198092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 283/575] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:26.198092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.211601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d898-561f-45fa-a70d-3d30041b98b8 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.222736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.248768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6308ec-0afb-4a81-8884-771dcef52e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.249604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6308ec-0afb-4a81-8884-771dcef52e37 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.249988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6308ec-0afb-4a81-8884-771dcef52e37 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.250366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6308ec-0afb-4a81-8884-771dcef52e37 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.251173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6308ec-0afb-4a81-8884-771dcef52e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:26.251488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6308ec-0afb-4a81-8884-771dcef52e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.252868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6308ec-0afb-4a81-8884-771dcef52e37 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.270488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 293/576] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:26.270488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b88b-a6d5-486f-a9f5-169a63ac8fa3 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.270488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b88b-a6d5-486f-a9f5-169a63ac8fa3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.270488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b88b-a6d5-486f-a9f5-169a63ac8fa3 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.270488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 294/577] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:26.270488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b88b-a6d5-486f-a9f5-169a63ac8fa3 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.320139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4e649-56c1-4690-b71c-27a01c017afc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.341508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.361252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.362109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.362291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.362595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.363406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:26.364951 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.366250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.387038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 284/578] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:26.388204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.405706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b88b-a6d5-486f-a9f5-169a63ac8fa3 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.449838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7417f-2c5d-45d4-a50a-288af2b67d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.450723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7417f-2c5d-45d4-a50a-288af2b67d5e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.451194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7417f-2c5d-45d4-a50a-288af2b67d5e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.451693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7417f-2c5d-45d4-a50a-288af2b67d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.463834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7417f-2c5d-45d4-a50a-288af2b67d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.465402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7417f-2c5d-45d4-a50a-288af2b67d5e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-eae7417f-2c5d-45d4-a50a-288af2b67d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:26.485716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:26.486844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:26.488050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:26.488050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:26.488050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:26.488050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:26.491410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.493079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 295/579] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:26.494269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838653-489a-42d7-82db-0669c9750b8b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.494408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838653-489a-42d7-82db-0669c9750b8b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.494686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838653-489a-42d7-82db-0669c9750b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.513415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-41838653-489a-42d7-82db-0669c9750b8b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:26.514918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-41838653-489a-42d7-82db-0669c9750b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:26.519152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81804-16c7-438e-95a5-5ca11af4efe6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.561726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.562308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.562594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.562873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.570254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.571758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:26.585040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:26.586131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:26.587194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:26.589353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 285/580] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:26.590247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.607641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 296/581] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:26.608654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41838653-489a-42d7-82db-0669c9750b8b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.684246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.728100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984099-8496-49af-ab9e-ec1c957e5781 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.769567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41838653-489a-42d7-82db-0669c9750b8b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.774628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.775290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.775569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.775844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.783699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.790096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.791703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:26.808514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:26.809493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:26.810449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:26.810449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:26.810449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:26.810449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:26.810449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 286/582] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:26.810859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.820490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.821029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.821309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.821621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.822629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:26.822629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.824000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:26.850579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 297/583] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:26.852449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:26.944472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e47e96-3039-48b3-abd1-75e63d85d413 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.966887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.971160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd03df-e1cd-4a5a-863b-014fb6d68d1e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:26.984582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:26.985214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:26.985502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:26.985925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:26.986581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:26.987085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:26.988370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.001215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 287/584] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:27.002128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.016501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.017473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.017855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.018199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.033888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:27.040189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:27.041385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:27.042447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:27.047161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 298/585] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:27.047474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.070615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:27.144466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6febd-16d9-4c1c-b18f-339f8b669297 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.162847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3683c93-1f24-4461-b0a9-84288a9c71e9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.186928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.187565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.187864 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.188147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.188849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:27.189158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.190591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.202583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.203352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.203639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.203918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.212186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 288/586] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:27.212186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.213317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.214973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:27.227689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:27.228771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 299/587] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:27.230318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.252352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:27.341172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec164567-c6a0-4801-b4ba-8853212cd117 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.346283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330651d-1cea-48fe-8031-273610c001fc None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.352466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:27.381032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.382062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.382551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.382840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/784ac400fc5643a589d79d0314ee4a19/roles/29678fc410464c378e9689814592e7b2` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.383640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.384266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.384555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.384837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.385591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:27.385904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.387697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.404530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 300/588] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:27.404530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.411475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=784ac400fc5643a589d79d0314ee4a19, role_id=29678fc410464c378e9689814592e7b2)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.413150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.487806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 289/589] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:27 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/784ac400fc5643a589d79d0314ee4a19/roles/29678fc410464c378e9689814592e7b2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:27.489724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.506636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:27.530903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a2c87-c561-4f07-a69c-e150539e16f2 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.580330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.581343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.582258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.582857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.591919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.593868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:27.608424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:27.609860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:27.610742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:27.618252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 301/590] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:27.619537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.632256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2e99e-d4b1-4145-87ea-c77bbbab5f7c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.680482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.681119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.681394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.681696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.682826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:27.683140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.684813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.705660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 290/591] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:27.706521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.733764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:27.794240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176aa0d-1c1e-4733-979f-76cb35596e2b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.833437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.834125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.834413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.834695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.849167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:27.852944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.855313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.864901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec0f2f-112a-4cbe-ae9c-ba2435805664 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:27.879385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:27.881138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:27.883758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:27.883758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:27.883758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:27.883758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:27.886854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 302/592] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:27.888199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:27.952700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:27.955911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.956706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.957763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.960334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:27.961341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:27.964337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:27.993706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 291/593] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:27.995633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.006584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b7b6-1de7-4ed4-8696-d56847d8ca67 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.045840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.047133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.047724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.048578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.061847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.063531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:28.081088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:28.082957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:28.085382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:28.085382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:28.085382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:28.085382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:28.085382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 303/594] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:28.085382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.126152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:28.145197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:28.150636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ffb1-25e7-4061-84d6-1f1341f03ad6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.190101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.190863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.191245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.191628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.192441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:28.192886 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.194700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.215195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 292/595] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:28.216182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0266-331e-423f-9e79-d8e29c67399e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.216396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.261805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.262750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.263654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.264126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/6bdef4163b5048ed9c9815683a44f019/roles/29678fc410464c378e9689814592e7b2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.283695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=6bdef4163b5048ed9c9815683a44f019, role_id=29678fc410464c378e9689814592e7b2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.285298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.341940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de1b06-cee5-4188-bba5-a2edc7e82453 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.386435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.386435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.386689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.386939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.387597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:28.387908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.389289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.397827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:28.401598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 304/596] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:28 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/6bdef4163b5048ed9c9815683a44f019/roles/29678fc410464c378e9689814592e7b2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:28.402680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.407853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 293/597] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:28.408860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.544926 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:28.556354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacd99-2f3c-4bdc-9713-c35a1df3063a None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.600048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b39c-09fe-4758-90b2-a6a987becfa5 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.613930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9a45-6cde-4852-b1d0-a796e34bdb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.615539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9a45-6cde-4852-b1d0-a796e34bdb69 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.615539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9a45-6cde-4852-b1d0-a796e34bdb69 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.615710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9a45-6cde-4852-b1d0-a796e34bdb69 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.624253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add9a45-6cde-4852-b1d0-a796e34bdb69 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.625765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add9a45-6cde-4852-b1d0-a796e34bdb69 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-9add9a45-6cde-4852-b1d0-a796e34bdb69 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:28.638509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:28.639663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 305/598] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:28.641118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6b2ed-a954-4c0b-914e-f99568e24838 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.643564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6b2ed-a954-4c0b-914e-f99568e24838 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.643564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6b2ed-a954-4c0b-914e-f99568e24838 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.643564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 306/599] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:28.649084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6b2ed-a954-4c0b-914e-f99568e24838 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.660394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a532d10-b2e0-4337-9ad9-af2394a8698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.661588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532d10-b2e0-4337-9ad9-af2394a8698c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.661839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532d10-b2e0-4337-9ad9-af2394a8698c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.662112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532d10-b2e0-4337-9ad9-af2394a8698c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.672056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a532d10-b2e0-4337-9ad9-af2394a8698c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.674299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a532d10-b2e0-4337-9ad9-af2394a8698c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0a532d10-b2e0-4337-9ad9-af2394a8698c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:28.690794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:28.692104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:28.693296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 294/600] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:28.694041 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4470eb-a8a4-4182-8a0e-2fc188883f11 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.694041 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4470eb-a8a4-4182-8a0e-2fc188883f11 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.694041 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4470eb-a8a4-4182-8a0e-2fc188883f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.716491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ff4470eb-a8a4-4182-8a0e-2fc188883f11 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:28.718253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ff4470eb-a8a4-4182-8a0e-2fc188883f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:28.780167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:28.787438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6b2ed-a954-4c0b-914e-f99568e24838 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.798372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 295/601] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:28.800194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4470eb-a8a4-4182-8a0e-2fc188883f11 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.824447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.824787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.825028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.825310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.826153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:28.826458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.827883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.846574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 307/602] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Aug 1 15:36:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:28.852202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.867373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:28.907672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4470eb-a8a4-4182-8a0e-2fc188883f11 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.944210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.945249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.945752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.946256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:28.947229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:28.947731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:28.949394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:28.959218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587315a-a8a0-4424-b73c-105c9bca5da3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:28.963404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 296/603] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:28.964901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:28.995610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:28.996260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:28.996542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:28.996815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.008002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:29.012919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:29.013954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:29.014784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 308/604] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:29.015863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:29.042087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:29.080331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a43ab-fa63-408e-87b2-9d040a2c2d01 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:29.090726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:29.119233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:29.120307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:29.120785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:29.121275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.126519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e844-c813-490f-963d-d8e6401dca8c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:29.136809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:29.138543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:29.155451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:29.156492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:29.157529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:29.157529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:29.157529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:29.157529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:29.157529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 297/605] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:29.158558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:29.169635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:29.170322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:29.170604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:29.170884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/5048d76e4ffb4e12bb76ad3c8e5095ad/roles/29678fc410464c378e9689814592e7b2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.186771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=5048d76e4ffb4e12bb76ad3c8e5095ad, role_id=29678fc410464c378e9689814592e7b2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:29.188244 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:29.286317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:29.286801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 309/606] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:29 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/5048d76e4ffb4e12bb76ad3c8e5095ad/roles/29678fc410464c378e9689814592e7b2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:29.288117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:29.295426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8520-69cd-4c78-a634-dc386723a3ad None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:29.356457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:29.357120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:29.357448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:29.357756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.358477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:29.358796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:29.361547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:29.370622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 298/607] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:29.379512 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:29.568208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a386e1-ebdf-42ea-b549-7faad7d8a0e4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:29.595035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d28a-c77e-4ba7-ae86-a01f6659cf39 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:29.598683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:29.614524 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:29.615170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:29.615456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:29.615746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.616462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:29.616775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:29.618274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:29.633752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 310/608] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:29.638100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:29.643434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:29.644413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:29.644980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:29.645971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.662525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:29.665210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:29.696730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:29.697795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:29.698688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:29.698688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:29.698688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:29.698688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:29.700745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 299/609] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:29.705935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:29.741229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:29.808663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5739d7a-f639-4f11-bd04-a3af5e05adfc None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:29.876958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:29.877546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:29.877900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:29.878182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.880680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087cfb-2b79-47ab-ac5e-9e76184b0c8f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:29.890440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:29.892020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:29.914188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:29.915147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:29.916006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 311/610] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:29.924621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:29.937054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:29.937741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:29.938028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:29.938308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:29.939011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:29.939321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:29.940714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:29.954405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 300/611] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:29.960003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:30.009971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.037858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.064807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc790a4-ef0d-40de-9587-56b294f3a968 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.101177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5878758-d24d-42f0-99d6-f56fc656921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:30.101865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878758-d24d-42f0-99d6-f56fc656921c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.102160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878758-d24d-42f0-99d6-f56fc656921c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.102449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878758-d24d-42f0-99d6-f56fc656921c None admin] PATH_INFO: `/v3/users/swift` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.110442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5878758-d24d-42f0-99d6-f56fc656921c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:30.110896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124583f-1eca-4336-8e95-731d202239ef None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.111920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5878758-d24d-42f0-99d6-f56fc656921c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-b5878758-d24d-42f0-99d6-f56fc656921c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:30.128238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:30.129462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:30.130781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 301/612] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:30.131530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de873a4-1b03-4289-9b66-81e047a927bf None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.131530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de873a4-1b03-4289-9b66-81e047a927bf None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.131677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de873a4-1b03-4289-9b66-81e047a927bf None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.134591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 302/613] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:30.138245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de873a4-1b03-4289-9b66-81e047a927bf None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:30.157510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e41772-08ad-418f-853c-66957dda78a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:30.158368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e41772-08ad-418f-853c-66957dda78a2 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.158744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e41772-08ad-418f-853c-66957dda78a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.159116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e41772-08ad-418f-853c-66957dda78a2 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.159992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e41772-08ad-418f-853c-66957dda78a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:30.160938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e41772-08ad-418f-853c-66957dda78a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:30.162565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e41772-08ad-418f-853c-66957dda78a2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:30.176041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 312/614] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:30.178177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463cd7-dc90-45b8-9def-5f61fd6bf9fd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.178560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463cd7-dc90-45b8-9def-5f61fd6bf9fd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.178935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463cd7-dc90-45b8-9def-5f61fd6bf9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.198507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-77463cd7-dc90-45b8-9def-5f61fd6bf9fd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:30.199850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-77463cd7-dc90-45b8-9def-5f61fd6bf9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:30.256298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de873a4-1b03-4289-9b66-81e047a927bf None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.276310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 313/615] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:30.277221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77463cd7-dc90-45b8-9def-5f61fd6bf9fd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:30.320215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:30.320845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.321131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.321410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.322327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:30.322643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:30.324231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:30.326102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.336789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.343776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 303/616] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 1 15:36:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:30.344637 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:30.413348 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77463cd7-dc90-45b8-9def-5f61fd6bf9fd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.451555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:30.452748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.453545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.454163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/90399c6cab2341f1af74d154c819bff9/roles/29678fc410464c378e9689814592e7b2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.457877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81e298-7c38-4ab1-b207-b4c38a202e13 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.474345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=90399c6cab2341f1af74d154c819bff9, role_id=29678fc410464c378e9689814592e7b2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:30.476169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:30.495160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:30.495845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.496133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.496408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.507957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:30.512988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:30.514695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:30.515537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:30.517657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 304/617] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:30.518827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:30.572051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 314/618] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:30 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/90399c6cab2341f1af74d154c819bff9/roles/29678fc410464c378e9689814592e7b2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:30.573216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:30.603675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.706343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c0b37-8eba-48e6-af6c-0cdf19f7ccec None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.749812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.774672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41d161-a589-4aaa-a712-381a5d1aef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:30.775663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d161-a589-4aaa-a712-381a5d1aef90 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.776044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d161-a589-4aaa-a712-381a5d1aef90 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.776922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d161-a589-4aaa-a712-381a5d1aef90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.790198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c742f-9a5c-4000-a501-6572a79477c0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.792975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41d161-a589-4aaa-a712-381a5d1aef90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:30.792975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41d161-a589-4aaa-a712-381a5d1aef90 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-8c41d161-a589-4aaa-a712-381a5d1aef90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:30.816535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:30.818671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 305/619] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d66e6-2ff6-45b5-a8b8-a90b700c0254 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d66e6-2ff6-45b5-a8b8-a90b700c0254 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.820680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d66e6-2ff6-45b5-a8b8-a90b700c0254 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.821671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 306/620] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:30.826572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d66e6-2ff6-45b5-a8b8-a90b700c0254 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:30.861094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ad3aa-96c3-43fe-a934-cd6fbcb2b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:30.861870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad3aa-96c3-43fe-a934-cd6fbcb2b127 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.862095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad3aa-96c3-43fe-a934-cd6fbcb2b127 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.862416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad3aa-96c3-43fe-a934-cd6fbcb2b127 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.863157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ad3aa-96c3-43fe-a934-cd6fbcb2b127 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:30.863450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ad3aa-96c3-43fe-a934-cd6fbcb2b127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:30.864859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ad3aa-96c3-43fe-a934-cd6fbcb2b127 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:30.874698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 315/621] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:30.875975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fed7a-c250-4b1a-8174-d7bbedb28007 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:30.876262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fed7a-c250-4b1a-8174-d7bbedb28007 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:30.876541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fed7a-c250-4b1a-8174-d7bbedb28007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:30.896390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7e4fed7a-c250-4b1a-8174-d7bbedb28007 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:30.897661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7e4fed7a-c250-4b1a-8174-d7bbedb28007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:30.961398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d66e6-2ff6-45b5-a8b8-a90b700c0254 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:30.965183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.971911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 316/622] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:30.982760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fed7a-c250-4b1a-8174-d7bbedb28007 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.004040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.005868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.006387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.007433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.008374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:31.009162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.011195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.029833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 307/623] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:31.031214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.081744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:31.110273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fed7a-c250-4b1a-8174-d7bbedb28007 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.152784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.153442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.153744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.154020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.168385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.169965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.176818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919045cf-b9c1-4fe8-b36d-96d3dba1f71a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:31.189229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:31.190387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:31.191485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:31.191485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:31.191485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:31.191485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:31.193627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 317/624] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:31.194789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.226290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.227480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.228303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.228741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.244015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:31.251970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:31.253007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:31.254060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:31.257372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 308/625] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:31.258359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.294022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:31.330223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0872c8a-6f2a-43f0-8945-95300ceba06e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.363430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:31.369228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.370528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.371396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.375351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.382787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.385984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.388204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f457a2c-8d38-4e68-9f74-58bd54f0f81c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:31.405177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:31.406354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:31.407434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:31.408220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 318/626] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:31.411913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.436456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.437456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.437771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.438220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.439172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:31.439960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.442640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.459138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 309/627] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:31.460521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.523550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d9d9-4ab2-43f1-a311-63ab6178bddc None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.563615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.564404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.564895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.565282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.566324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:31.567325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.568877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.573634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:31.583365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 319/628] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:31.587859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.597199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a7ca-b73c-420f-9b3b-614f2f59a0c0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.637429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.638482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.638990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.639443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.640594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:31.640908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:31.642115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.643778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.656692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 310/629] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:31.658007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.700113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a31c-09f6-46f8-9780-bad45f9cb2a3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.733927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb9da-8b20-4e24-abc5-c9cfe7417921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.734669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb9da-8b20-4e24-abc5-c9cfe7417921 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.735011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb9da-8b20-4e24-abc5-c9cfe7417921 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.735352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb9da-8b20-4e24-abc5-c9cfe7417921 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.743675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eb9da-8b20-4e24-abc5-c9cfe7417921 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.745221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eb9da-8b20-4e24-abc5-c9cfe7417921 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-901eb9da-8b20-4e24-abc5-c9cfe7417921 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:31.756531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:31.757487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:31.758474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 320/630] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:31.759090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566a9b4-a88b-49bd-91d0-717eff4d3810 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.759158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566a9b4-a88b-49bd-91d0-717eff4d3810 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.760335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566a9b4-a88b-49bd-91d0-717eff4d3810 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.760823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 321/631] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:31.765572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566a9b4-a88b-49bd-91d0-717eff4d3810 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.782001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a1a6-2739-4ca9-a028-87d1a49be061 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.822503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.823158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.823450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.823727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.834425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.835876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.838495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:31.851632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:31.862528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:31.863421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:31.863421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:31.863421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:31.863421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:31.863421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 311/632] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:31.863421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:31.884879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566a9b4-a88b-49bd-91d0-717eff4d3810 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:31.894532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:31.920478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386609d-908e-4409-b059-b24fa8766737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:31.921174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386609d-908e-4409-b059-b24fa8766737 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.921480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386609d-908e-4409-b059-b24fa8766737 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.921746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386609d-908e-4409-b059-b24fa8766737 None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/159e2784eaf44126b4e04dacbb328add/roles/29678fc410464c378e9689814592e7b2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.939227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386609d-908e-4409-b059-b24fa8766737 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=159e2784eaf44126b4e04dacbb328add, role_id=29678fc410464c378e9689814592e7b2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:31.940771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386609d-908e-4409-b059-b24fa8766737 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:31.968527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823125d-00e8-484a-a259-b6f35b51da43 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.001181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.001827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.002111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.002387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.003167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:32.003475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.004944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.017505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 322/633] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:31 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/159e2784eaf44126b4e04dacbb328add/roles/29678fc410464c378e9689814592e7b2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:32.019456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac7f3-9e3f-4c61-a2c4-72781f3a4da0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.020678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac7f3-9e3f-4c61-a2c4-72781f3a4da0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.021110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac7f3-9e3f-4c61-a2c4-72781f3a4da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.022739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 312/634] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:36:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:32.023618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.048291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-582ac7f3-9e3f-4c61-a2c4-72781f3a4da0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:32.049873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-582ac7f3-9e3f-4c61-a2c4-72781f3a4da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:32.099858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.138346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 323/635] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:32.139838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ac7f3-9e3f-4c61-a2c4-72781f3a4da0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.162768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2b2f-080a-4b46-aa73-cfff8b41a0cc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.209399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.210087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.210503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.210768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.211541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:32.212432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.213933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.225777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 313/636] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:32.226882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.265661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.278083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ac7f3-9e3f-4c61-a2c4-72781f3a4da0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.332972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.333861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.334217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.334982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.341682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68045-5c7e-41d0-bab2-47c51a42c46a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.358157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.385787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.386739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.387235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.387776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.402833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:32.411780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:32.412749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:32.413638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:32.415077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 314/637] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:32.415757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.427777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.429268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.529399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.546314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2f2b2-1f34-4a0a-a946-3f83ab1487d7 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.552497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 324/638] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:32.552497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.603633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.603633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.603633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.603633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.604138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.604138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:32.615634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:32.616731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:36:32.617935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:32.620143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 315/639] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:32.621350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.670677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.677993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372a869-ff69-42d2-8ce2-a3dfb16168df None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.714794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.715589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.716127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.716513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.717327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:32.717764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.719265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.727422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84986db-c2f9-4c1c-9624-d2ede8595d03 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.729015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 325/640] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:32.730088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.764023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.764777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.765141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.765574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.778795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.780321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.784190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:32.795570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:32.801950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:32.802838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:32.802838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:32.802838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:32.802838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:32.802838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 316/641] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:32.802838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.838279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef85da-ea99-4337-8955-e68a483373c2 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.874582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caa3b-8ae2-4fee-ad7d-fe580001f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.875207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caa3b-8ae2-4fee-ad7d-fe580001f9ff None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.875493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caa3b-8ae2-4fee-ad7d-fe580001f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.875768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caa3b-8ae2-4fee-ad7d-fe580001f9ff None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.876561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caa3b-8ae2-4fee-ad7d-fe580001f9ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:32.876863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caa3b-8ae2-4fee-ad7d-fe580001f9ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.878341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caa3b-8ae2-4fee-ad7d-fe580001f9ff None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.888900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.897646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 326/642] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:32.898688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc8fd-83ea-4a8f-bd8d-87d272c95057 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.898976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc8fd-83ea-4a8f-bd8d-87d272c95057 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.899251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc8fd-83ea-4a8f-bd8d-87d272c95057 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.904367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 327/643] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:32.905113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc8fd-83ea-4a8f-bd8d-87d272c95057 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:32.909945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29119a-0e20-40ca-85ac-f83672bfc4eb None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:32.945417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:32.946091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:32.946377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:32.946695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.958306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:32.959759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:32.975364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:32.976275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:32.977300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:32.977300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:32.977300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:32.977300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:32.981182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 317/644] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:32.981899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.014526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc8fd-83ea-4a8f-bd8d-87d272c95057 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.024396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.051256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2dcd8-3c73-4014-9ae3-4f4dab7bfdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.051874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2dcd8-3c73-4014-9ae3-4f4dab7bfdd5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.052163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2dcd8-3c73-4014-9ae3-4f4dab7bfdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.052441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2dcd8-3c73-4014-9ae3-4f4dab7bfdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.053131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2dcd8-3c73-4014-9ae3-4f4dab7bfdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:33.053441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2dcd8-3c73-4014-9ae3-4f4dab7bfdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.055104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2dcd8-3c73-4014-9ae3-4f4dab7bfdd5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.068565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 328/645] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:33.069941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c388265-f316-4ee1-ac9d-e7f279aea123 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.070236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c388265-f316-4ee1-ac9d-e7f279aea123 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.070518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c388265-f316-4ee1-ac9d-e7f279aea123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.089032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0bbe4-1ec0-48c4-b38e-763dfe30ddde None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.089371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9c388265-f316-4ee1-ac9d-e7f279aea123 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:33.090747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9c388265-f316-4ee1-ac9d-e7f279aea123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:33.124379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.125068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.125301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.125618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.134879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.165698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 329/646] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:33.165698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c388265-f316-4ee1-ac9d-e7f279aea123 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.206883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.208907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.285252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c388265-f316-4ee1-ac9d-e7f279aea123 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.286957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.317504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 318/647] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:33.318500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.324477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.325178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.325459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.325772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.326466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:33.326771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.328271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.345398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 330/648] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:33.345398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.366696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.433839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8743e8f-9652-48c0-9b69-2c00451d0cdd None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.449404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf148-ccae-4440-9ead-dd291ce0c853 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.471114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.471764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.472051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.472317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.479541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.480973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.485979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.486790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.487270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.487698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:33.492137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:33.493196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:33.494145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 319/649] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:33.494646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.504576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:33.510575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:33.511670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:33.512640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:33.514740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 331/650] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:33.515803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.539587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.607026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.611217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf583a3-2efe-4e1c-a73b-3c6486eafdd9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.628001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909fc7-4af3-436c-81e0-50af34da536d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.649214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.649896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.650170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.650453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.661188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.662705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.664214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.664890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.665208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.665473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.675609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.677617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:33.680174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:33.686277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:33.687205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:33.687205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:33.687205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:33.687205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:33.687205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 320/651] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:33.687205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:33.690604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:33.691498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 332/652] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:33.694264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.777615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.799701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672985e-36eb-4cf9-91ed-724da4a4aaef None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.802911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371dc1-0550-4b9b-972f-3fc5e3f38cb7 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.836838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.837472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.837808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.838088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.838835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:33.839146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.839243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.839821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.840153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.840436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.840600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.841145 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:33.841446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.842990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:33.851932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 333/653] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:33.852564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.858291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 321/654] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:33.862488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:33.878704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.954913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff8728-712e-4d87-a2a3-70f24c51321a None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.970926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564a50c-fece-474d-8b90-5d6efff95f69 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:33.988947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:33.989698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.989989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.990257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.990956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:33.991262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:33.992692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.001702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.009498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 334/655] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:34.009498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.017295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.017295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.017295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.017295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.017709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:34.017709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.017709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.034405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 322/656] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 1 15:36:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:34.035758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.104410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.122026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959793d7-25c7-4a42-9383-f72242eb108b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.137629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c082-8dde-4911-a09b-448033b8c5d0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.158974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.159633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.159919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.160229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.170343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.171795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.172768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.173423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.173715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.173988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.174763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=784ac400fc5643a589d79d0314ee4a19) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:34.175069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.176607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.182506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 323/657] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/role_assignments?user.id=784ac400fc5643a589d79d0314ee4a19&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:34.183270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:34.186482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:34.187383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:34.188281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:34.188281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:34.188281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:34.188281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:34.188281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 335/658] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:34.188886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.256480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.298782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa14d47-984f-4818-bcd7-e0cae7b49e29 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.323832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a46944-8963-46c8-b1de-966796db6d5d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.333262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.339005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98209d-5192-4d50-9924-849a477fc690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.339832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98209d-5192-4d50-9924-849a477fc690 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.339949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98209d-5192-4d50-9924-849a477fc690 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.340151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98209d-5192-4d50-9924-849a477fc690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.347072 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98209d-5192-4d50-9924-849a477fc690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.348619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98209d-5192-4d50-9924-849a477fc690 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-fd98209d-5192-4d50-9924-849a477fc690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:34.360734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:34.362008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:34.363006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 324/659] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:34.364308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7f55b-40a4-4718-857a-4be476ec1702 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.364308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7f55b-40a4-4718-857a-4be476ec1702 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.364308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7f55b-40a4-4718-857a-4be476ec1702 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.365387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 325/660] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:34.366100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7f55b-40a4-4718-857a-4be476ec1702 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.366468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bf6ec-6d9b-4090-a76e-b88c8fccbfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.367354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf6ec-6d9b-4090-a76e-b88c8fccbfdb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.367650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf6ec-6d9b-4090-a76e-b88c8fccbfdb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.367999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf6ec-6d9b-4090-a76e-b88c8fccbfdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.448821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf6ec-6d9b-4090-a76e-b88c8fccbfdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.450333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf6ec-6d9b-4090-a76e-b88c8fccbfdb None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.487146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7f55b-40a4-4718-857a-4be476ec1702 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.501487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.531608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.532142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.532427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.532725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.533420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:34.533753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.535421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.549365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 326/661] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:34.550236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.565290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 336/662] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:34.567575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce62e-fe65-4568-aeef-e270ecf3c770 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.568063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce62e-fe65-4568-aeef-e270ecf3c770 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.568532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce62e-fe65-4568-aeef-e270ecf3c770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.586713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-630ce62e-fe65-4568-aeef-e270ecf3c770 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:34.590741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-630ce62e-fe65-4568-aeef-e270ecf3c770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:34.612501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.662343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 337/663] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:34.664690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d991bd-3e45-4e77-b4e2-cf7c8873bb3e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.666561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ce62e-fe65-4568-aeef-e270ecf3c770 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.702771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.703398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.703681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.703957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.704704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:34.705073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.706478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.718348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 327/664] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:34.719239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.768342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.788448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ce62e-fe65-4568-aeef-e270ecf3c770 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.825919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.826616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.826906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.827190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.827318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8419f3-1126-4473-b2c6-941448dba536 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:34.834957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.836468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.841131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:34.850392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:34.854898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 338/665] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:34.855817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.868684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:34.869337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:34.869724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:34.870017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:34.882207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:34.884155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:34.901564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:34.902682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:34.903554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:34.903554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:34.903554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:34.903554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:34.903554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 328/666] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:34.903554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:34.969556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e238b6-09c9-497f-b976-ba629c7b4e77 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.010181 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.010936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.011224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.011504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.012369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851d20f-cbf0-45ab-93b9-72f3b80860d9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.022763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:35.028105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:35.029018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:35.030271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 339/667] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:35.030967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.037036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.050018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.050574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.050891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.051166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.051947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=6bdef4163b5048ed9c9815683a44f019) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:35.052257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.053736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.069545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 329/668] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:34 2022] GET /identity/v3/role_assignments?user.id=6bdef4163b5048ed9c9815683a44f019&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:35.069545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.107777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.162320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c2461-91a7-46c7-a892-0e2d924eaf52 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.203026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.203857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.204239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.204616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.205786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:35.206191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.207793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.209218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4557-7dae-4796-9494-ffbf1974924f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.228838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 340/669] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:35.230029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.248739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.249873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.250160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.250439 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.251289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:35.251517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.254662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.268297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 330/670] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:35.269230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.317337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.373114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd9a38-aeba-4ccb-9137-ded7ee236be6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.379193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.392146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb5d2-a979-42ba-937d-5cb21d91af91 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.414590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.415499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.416036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.416527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.417452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:35.418053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.421134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.431962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 341/671] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:35.433012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.433392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.433833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.434187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.434538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.524500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.526360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.549219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9c877-59ee-42f9-ac97-db9d9329df19 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.582143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.602382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.602759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.603250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.603726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.612053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.614407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.628242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:35.629207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:35.640476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 342/672] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:35.641657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.665571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 331/673] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:35.665571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.766917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320dd07-7beb-4c85-9594-5df4597e8e64 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.794768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8cce-e5f4-444c-adf1-5b11802dd625 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.803827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.804519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.804896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.805271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.817480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.819109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:35.835349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:35.836458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:35.837633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:35.837633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:35.837633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:35.837633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:35.839100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 343/674] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:35.839266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:35.840105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.840311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:35.840734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:35.841157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:35.842104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:35.842562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:35.844459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:35.865682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 332/675] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:35.866760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:35.886316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.928634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:35.968204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac48c-9c0a-4be8-8a11-43fc49b5ea19 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:35.988194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d0b60-fffc-414d-a82e-c19df52b7c97 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.012109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.014676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.015615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.016574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.036222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.038080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.047232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.048268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.048771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.049251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.050239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:36.050805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.052483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:36.061083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:36.062001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:36.062895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:36.062895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:36.062895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:36.062895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:36.067148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 344/676] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:36.068161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.068379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 333/677] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:36.069449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.160806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:36.176961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c68d2-bd00-4559-adc2-286eb2715bb0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.178596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a0c87-2e0c-4572-adef-856c0dee1a9c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.188339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:36.215488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.216527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.216876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.217241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.217745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.218080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.218184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.218468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.219239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:36.219513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=5048d76e4ffb4e12bb76ad3c8e5095ad) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:36.219614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.220074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.221185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.222083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.230000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 345/678] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/role_assignments?user.id=5048d76e4ffb4e12bb76ad3c8e5095ad&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:36.231033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.247139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 334/679] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:36.248608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.358779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96453d46-e997-4760-b8c8-b2f976714b6c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.403516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51328be1-8044-4514-81b6-839e6ba4f361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.405057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51328be1-8044-4514-81b6-839e6ba4f361 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.405542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51328be1-8044-4514-81b6-839e6ba4f361 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.406122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51328be1-8044-4514-81b6-839e6ba4f361 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.415396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51328be1-8044-4514-81b6-839e6ba4f361 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.415793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922812f-2f58-452c-8b5f-430c9e07dcd6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.417857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51328be1-8044-4514-81b6-839e6ba4f361 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-51328be1-8044-4514-81b6-839e6ba4f361 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:36.431191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:36.432454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:36.433368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:36.436054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 346/680] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:36.437563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f55d-0774-4770-a943-59af888f365e None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.437990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f55d-0774-4770-a943-59af888f365e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.438392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f55d-0774-4770-a943-59af888f365e None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.440141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 347/681] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:36.447415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f55d-0774-4770-a943-59af888f365e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.459483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8070d6-4ef8-414c-9245-2e8d157b4cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.460699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8070d6-4ef8-414c-9245-2e8d157b4cdd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.461189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8070d6-4ef8-414c-9245-2e8d157b4cdd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.461719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8070d6-4ef8-414c-9245-2e8d157b4cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.462274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:36.471035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8070d6-4ef8-414c-9245-2e8d157b4cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.472901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8070d6-4ef8-414c-9245-2e8d157b4cdd None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-cc8070d6-4ef8-414c-9245-2e8d157b4cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:36.486695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:36.492585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 335/682] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685073d-efb1-46c1-909c-cfe89b2154ca None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.493693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685073d-efb1-46c1-909c-cfe89b2154ca None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.494304 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685073d-efb1-46c1-909c-cfe89b2154ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.512840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8685073d-efb1-46c1-909c-cfe89b2154ca None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:36.514066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8685073d-efb1-46c1-909c-cfe89b2154ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:36.541442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:36.574866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f55d-0774-4770-a943-59af888f365e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.596929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 336/683] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:36.598114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685073d-efb1-46c1-909c-cfe89b2154ca None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.619393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.620107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.620467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.620815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.621739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:36.622141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.623654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.649931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 348/684] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:36.650803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.722718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:36.724930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685073d-efb1-46c1-909c-cfe89b2154ca None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.759705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647a9bc-88c6-4fb4-8eba-cfb45660ecf6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.763662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.764374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.764754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.765141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.766021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:36.766417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:36.768192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:36.781971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 337/685] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:36.782921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.802205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.802862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.803151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.803541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.804496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:36.815927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:36.821915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:36.823077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:36.823973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:36.829788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 349/686] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:36.830867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:36.894624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22011b9-df3c-425d-93b0-0cd612513d12 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.932110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.932741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.933920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.934601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.949149 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be62d4-5d8c-44da-8515-82ea152ec15b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:36.983235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:36.994941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:36.995866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:36.996377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:36.997274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:36.998639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=90399c6cab2341f1af74d154c819bff9) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:36.999196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.001710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.010051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 350/687] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/role_assignments?user.id=90399c6cab2341f1af74d154c819bff9&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:37.010977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.015582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.018413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.046346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.145997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 338/688] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:37.154710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.221782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fffb7-16f0-4c55-a515-8fcee633a30d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.259016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f20ac-d0c9-46eb-851a-391e72e0ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.259658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f20ac-d0c9-46eb-851a-391e72e0ae54 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.259942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f20ac-d0c9-46eb-851a-391e72e0ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.260226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f20ac-d0c9-46eb-851a-391e72e0ae54 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.260952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f20ac-d0c9-46eb-851a-391e72e0ae54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:37.261261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f20ac-d0c9-46eb-851a-391e72e0ae54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.262682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f20ac-d0c9-46eb-851a-391e72e0ae54 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.273159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 351/689] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:37.278878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118d18-0908-4e9f-b7f4-8dd54c4f4192 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.278878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118d18-0908-4e9f-b7f4-8dd54c4f4192 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.279205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118d18-0908-4e9f-b7f4-8dd54c4f4192 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.280761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 352/690] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:37.283646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118d18-0908-4e9f-b7f4-8dd54c4f4192 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.322268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0a556-c152-45bf-a693-7583ad880146 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.343515 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.349275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.369771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee312f4-fd12-4580-989a-ce824aea8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.370599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee312f4-fd12-4580-989a-ce824aea8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.370985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee312f4-fd12-4580-989a-ce824aea8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.371363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee312f4-fd12-4580-989a-ce824aea8cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.385143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee312f4-fd12-4580-989a-ce824aea8cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.386787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee312f4-fd12-4580-989a-ce824aea8cd5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-aee312f4-fd12-4580-989a-ce824aea8cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:37.402423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:37.403355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:37.404695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:37.404695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:37.404695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:37.404695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:37.404695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 339/691] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:37.405209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290ba9b-350c-4834-97a2-be5ddaf51573 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.405495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290ba9b-350c-4834-97a2-be5ddaf51573 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.409863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290ba9b-350c-4834-97a2-be5ddaf51573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.410715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118d18-0908-4e9f-b7f4-8dd54c4f4192 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.433568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-6290ba9b-350c-4834-97a2-be5ddaf51573 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:37.435314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6290ba9b-350c-4834-97a2-be5ddaf51573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:37.452060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.452888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.453263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.453701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.465002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.466683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:37.486435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:37.487447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:37.488967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:37.488967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:37.488967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:37.488967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:37.491336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 353/692] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:37.492842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.521408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 340/693] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:37.522372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290ba9b-350c-4834-97a2-be5ddaf51573 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.628461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.632228 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290ba9b-350c-4834-97a2-be5ddaf51573 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.635770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da124-fceb-4cd7-ae44-0d2a1fea2708 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.649663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.681190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.682423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.682784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.683131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.684042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:37.684437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.685483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.685863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.686385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.686778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.687165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.688187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:37.689198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.691042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.703397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 354/694] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:37.704345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.709598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 341/695] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:37.710517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.825658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe571a7-8855-41ca-be67-d829275b1c39 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.841111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c8a1f-fbb7-435f-9e57-5e8df16340e3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.874450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.875494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.876037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.876567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.877465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.877627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.878423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.878832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.879202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.879664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.886720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.888283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:37.893233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:37.894456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:37.895494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:37.897999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 355/696] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:37.899364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:37.905561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:37.906457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:37.907462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:37.908229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 342/697] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:37.909189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.939601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.944336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:38.022699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059245ba-ce5f-4901-a19d-d6824be84783 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.037163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ddb5-6662-4e2a-b4bf-da67037025d2 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.057940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.058592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.058877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.059159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.067188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.068678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.076525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.077401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.077999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.078494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.079431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:38.079940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:38.080494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:38.081405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:38.082920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:38.085100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.086821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 356/698] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:38.087876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:38.095654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 343/699] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:38.096906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:38.181126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:38.190835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ce06-6621-4997-92bf-a945bec64402 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.192383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:38.209551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc703dc-4e36-4b26-899b-50bc75ae72dd None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.226603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.227205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.227494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.227777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.228694 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:38.228947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.230431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.243397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 357/700] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:38.244328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:38.251252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.252295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.252834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.253416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.254490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:38.255118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.257037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.278254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 344/701] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:38.279647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:38.353196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f578665-c792-4eb2-85c6-b5c3bf6348be None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.389763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.390350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.390624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.390905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.391598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:38.391911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.393324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.397486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73a798-5757-4fe6-b20b-a4096811e3ea None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.406258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 358/702] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:38.406842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:38.435762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:38.446830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c272ff-b16e-4e2b-9b25-d1f81907e477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.450086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c272ff-b16e-4e2b-9b25-d1f81907e477 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.450636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c272ff-b16e-4e2b-9b25-d1f81907e477 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.451110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c272ff-b16e-4e2b-9b25-d1f81907e477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.453993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c272ff-b16e-4e2b-9b25-d1f81907e477 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=159e2784eaf44126b4e04dacbb328add) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:38.454657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c272ff-b16e-4e2b-9b25-d1f81907e477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.457575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c272ff-b16e-4e2b-9b25-d1f81907e477 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.469396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 345/703] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/role_assignments?user.id=159e2784eaf44126b4e04dacbb328add&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:38.585170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766767-be7b-4b2b-9d12-55df0c175265 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.585482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766767-be7b-4b2b-9d12-55df0c175265 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.585758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766767-be7b-4b2b-9d12-55df0c175265 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.587417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 346/704] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:38.593467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c113-f5e6-432f-abe0-e4cf9332ab99 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.594890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c113-f5e6-432f-abe0-e4cf9332ab99 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.596159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c113-f5e6-432f-abe0-e4cf9332ab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.599130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137df04-6926-4b9b-832e-bed8df2c5311 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.621337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:38.625831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d0f0c113-f5e6-432f-abe0-e4cf9332ab99 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:38.627134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d0f0c113-f5e6-432f-abe0-e4cf9332ab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:38.667098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.667887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.668175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.668453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.711614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 347/705] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:38.739883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c113-f5e6-432f-abe0-e4cf9332ab99 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:38.757219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.759043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.775875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:38.856780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c113-f5e6-432f-abe0-e4cf9332ab99 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:38.891148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 359/706] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:38.896826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:38.898668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:38.899399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:38.899837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:38.900108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:38.903519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:38.913935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:38.915648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:38.932646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:38.933646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:38.934535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:38.934535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:38.934535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:38.934535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:38.937811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 348/707] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:38.940871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:39.023840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5648d1-5648-4744-97c5-837ac101f50f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:39.040343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:39.065147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:39.067199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.067667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.068280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.081163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:39.082964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:39.101540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:39.102483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:39.103353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:39.103353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:39.103353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:39.103353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:39.105629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 360/708] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:39.110631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:39.187680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4a27-acd4-44f8-951a-e0f12c7149ce None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:39.228851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff68c27-9c64-42ac-9482-c8c5ff557b70 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:39.268537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:39.269180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.269471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.269795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.270461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:39.270768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:39.271180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:39.272017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.272169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:39.272628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.273075 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.274245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:39.274734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:39.276347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:39.292378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 361/709] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:39.298549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:39.300305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 349/710] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:39.306756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:39.357302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:39.403254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:39.461271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d953-fadd-43a4-99b2-f5fd7e1eec97 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:39.500301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d92ddf-2f02-46e4-82d1-1341c3b4ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:39.500998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92ddf-2f02-46e4-82d1-1341c3b4ea0a None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.501280 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92ddf-2f02-46e4-82d1-1341c3b4ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.501872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92ddf-2f02-46e4-82d1-1341c3b4ea0a None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.502552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d92ddf-2f02-46e4-82d1-1341c3b4ea0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:39.504184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d92ddf-2f02-46e4-82d1-1341c3b4ea0a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:39.513488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c959c-d599-4584-9b47-ff56cc803a35 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:39.552603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b998f7-b98d-497c-89d7-6322555cdb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:39.553648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b998f7-b98d-497c-89d7-6322555cdb44 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.554150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b998f7-b98d-497c-89d7-6322555cdb44 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.554705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b998f7-b98d-497c-89d7-6322555cdb44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.562442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b998f7-b98d-497c-89d7-6322555cdb44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:39.564148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b998f7-b98d-497c-89d7-6322555cdb44 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e6b998f7-b98d-497c-89d7-6322555cdb44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:39.576431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:39.577363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:39.578278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:39.578685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 362/711] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:39.579845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c457a2-445e-435a-9a9f-cc38adc52326 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.580135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c457a2-445e-435a-9a9f-cc38adc52326 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.580418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c457a2-445e-435a-9a9f-cc38adc52326 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.581919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 363/712] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:39.585595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c457a2-445e-435a-9a9f-cc38adc52326 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:39.604745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 350/713] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:36:39 2022] POST /identity/v3/users => generated 254 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:39.605272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9a90-3ba8-4686-a377-53cb2915eb91 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.605619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9a90-3ba8-4686-a377-53cb2915eb91 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.605906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9a90-3ba8-4686-a377-53cb2915eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.648097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-55af9a90-3ba8-4686-a377-53cb2915eb91 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:39.649331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-55af9a90-3ba8-4686-a377-53cb2915eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:39.745990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:39.774621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c457a2-445e-435a-9a9f-cc38adc52326 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:39.822367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 351/714] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:39.840631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:39.841510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:39.841979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:39.842400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:39.843643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:39.844104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:39.845717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:39.853069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af9a90-3ba8-4686-a377-53cb2915eb91 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:39.860130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 364/715] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:39.873756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:39.896744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:39.977358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af9a90-3ba8-4686-a377-53cb2915eb91 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:40.026324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:40.026547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.026711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.026944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] PATH_INFO: `/v3/services/network` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.027595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:40.029016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:40.041237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:40.042587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:40.043634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:40.044716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 352/716] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:39 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:40.052904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:40.142300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79826bd-1bcc-45cb-bef9-941fcce99019 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:40.189295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:40.195108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c7075-7fa0-46b8-a8d5-10b5cc24cf15 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:40.224112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:40.224740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.225025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.225303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.226124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=784ac400fc5643a589d79d0314ee4a19) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:40.226434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:40.227955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:40.238535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 365/717] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:39 2022] GET /identity/v3/role_assignments?user.id=784ac400fc5643a589d79d0314ee4a19&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:40.240568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65fd0-7c50-479c-886c-63d503484402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:40.241758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65fd0-7c50-479c-886c-63d503484402 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.242189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65fd0-7c50-479c-886c-63d503484402 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.242604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65fd0-7c50-479c-886c-63d503484402 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.243438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65fd0-7c50-479c-886c-63d503484402 None admin] RBAC: Adding query filter params (name=network) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:40.243906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65fd0-7c50-479c-886c-63d503484402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:40.245491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65fd0-7c50-479c-886c-63d503484402 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:40.251519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 353/718] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:36:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:40.257557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:40.272069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:40.406318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6323-e4f7-43a5-b83b-fb8e7240d6c9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:40.454861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b92a73-511a-43fd-b62d-6d47101700da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:40.455494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b92a73-511a-43fd-b62d-6d47101700da None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.455778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b92a73-511a-43fd-b62d-6d47101700da None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.456059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b92a73-511a-43fd-b62d-6d47101700da None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.457284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b92a73-511a-43fd-b62d-6d47101700da None admin] RBAC: Adding query filter params (type=network) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:40.457616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b92a73-511a-43fd-b62d-6d47101700da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:40.458997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b92a73-511a-43fd-b62d-6d47101700da None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:40.464224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 366/719] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:36:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:40.887063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5739-7f69-48e1-92e1-0df5d6250cd1 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.887585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5739-7f69-48e1-92e1-0df5d6250cd1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.887721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5739-7f69-48e1-92e1-0df5d6250cd1 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.889297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 354/720] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:40.894672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f11b8-1477-41cf-81c7-19590fdc6af5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.895123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f11b8-1477-41cf-81c7-19590fdc6af5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.895299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f11b8-1477-41cf-81c7-19590fdc6af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.922548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-071f11b8-1477-41cf-81c7-19590fdc6af5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:40.923780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-071f11b8-1477-41cf-81c7-19590fdc6af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:41.007492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 367/721] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:41.029922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5739-7f69-48e1-92e1-0df5d6250cd1 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:41.139016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a7c99-e0ab-4860-8da6-02a2e708f0f0 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:41.139312 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a7c99-e0ab-4860-8da6-02a2e708f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:41.139493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a7c99-e0ab-4860-8da6-02a2e708f0f0 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:41.140955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 368/722] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:41.153572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fba51-263f-42b1-80a8-6a2d0a21725a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:41.153572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fba51-263f-42b1-80a8-6a2d0a21725a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:41.153572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fba51-263f-42b1-80a8-6a2d0a21725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:41.163865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:41.187532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1e9fba51-263f-42b1-80a8-6a2d0a21725a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:41.189054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1e9fba51-263f-42b1-80a8-6a2d0a21725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:41.405657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 369/723] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:41.449885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5739-7f69-48e1-92e1-0df5d6250cd1 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:41.453623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fba51-263f-42b1-80a8-6a2d0a21725a None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:41.546275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:41.547292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:41.549012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:41.549556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:41.551340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:41.554915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:41.673775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 355/724] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:36:41 2022] POST /identity/v3/services => generated 251 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:41.718263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fba51-263f-42b1-80a8-6a2d0a21725a None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:41.789351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:41.799839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:41.800953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:41.801400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:41.801856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:41.819648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:41.825489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:41.826408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:41.827685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:41.830383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 370/725] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:41.837049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:41.868240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:41.972569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aec5b-1919-4f4d-ad80-11f986605e0a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:42.018692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:42.019882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.020163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.020437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.021173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:42.021478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:42.022975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:42.032717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 356/726] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:42.038079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:42.159707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74812da3-4ae4-4553-8099-e8e1875b2036 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:42.201765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:42.202411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.202689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.202961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.214704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:42.216153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:42.231382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:42.232314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:42.234102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:42.234102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:42.234102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:42.234102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:42.234102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 371/727] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:42.238185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:42.341902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:42.355219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd88ae-d10c-4a98-a311-a4147a124585 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:42.390713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260911e-1775-4a91-8285-efac04322b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:42.391386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260911e-1775-4a91-8285-efac04322b2f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.391673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260911e-1775-4a91-8285-efac04322b2f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.391950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260911e-1775-4a91-8285-efac04322b2f None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.392639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260911e-1775-4a91-8285-efac04322b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:42.392942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260911e-1775-4a91-8285-efac04322b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:42.395009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260911e-1775-4a91-8285-efac04322b2f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:42.407492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 357/728] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:42.414819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:42.467960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:42.504195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022908-cf57-4291-a320-0b583d59f4fe None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.504386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022908-cf57-4291-a320-0b583d59f4fe None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.504653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022908-cf57-4291-a320-0b583d59f4fe None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.506344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 358/729] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:42.523527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab4d55-4dd8-4cec-b6af-f602e0434bba None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.523824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab4d55-4dd8-4cec-b6af-f602e0434bba None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.524108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab4d55-4dd8-4cec-b6af-f602e0434bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.557448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-9cab4d55-4dd8-4cec-b6af-f602e0434bba None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:42.560321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9cab4d55-4dd8-4cec-b6af-f602e0434bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:42.576607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b882c4-495f-48dd-aa83-90ce1b01debf None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:42.619175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:42.620326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.620785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.621266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.630676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:42.632467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:42.646336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:42.647304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:42.648219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:42.650897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 372/730] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:42.657066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:42.729339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 359/731] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:36:42.767973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab4d55-4dd8-4cec-b6af-f602e0434bba None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:42.840233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8c99-77de-42ce-939c-37fc235bce7d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:42.841775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:42.857979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:42.875495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8878-12dc-45d5-bf01-eb0f0b884e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:42.876354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8878-12dc-45d5-bf01-eb0f0b884e39 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.876817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8878-12dc-45d5-bf01-eb0f0b884e39 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.877259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8878-12dc-45d5-bf01-eb0f0b884e39 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.878807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8878-12dc-45d5-bf01-eb0f0b884e39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:42.879266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8878-12dc-45d5-bf01-eb0f0b884e39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:42.880849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8878-12dc-45d5-bf01-eb0f0b884e39 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:42.888806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab4d55-4dd8-4cec-b6af-f602e0434bba None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:42.899663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 373/732] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 1 15:36:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:42.901133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfa65-b196-4f2d-aa36-f45a74e2563b None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.901598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfa65-b196-4f2d-aa36-f45a74e2563b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.902028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfa65-b196-4f2d-aa36-f45a74e2563b None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.907196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 374/733] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:42.907196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f5a4-96c4-4a11-b765-f3a70db6a067 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.907196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f5a4-96c4-4a11-b765-f3a70db6a067 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.907492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f5a4-96c4-4a11-b765-f3a70db6a067 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.908681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 375/734] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:42.910341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f5a4-96c4-4a11-b765-f3a70db6a067 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:42.929616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ca352-9716-49a7-95ad-2f198041bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:42.930265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca352-9716-49a7-95ad-2f198041bc43 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.930550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca352-9716-49a7-95ad-2f198041bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.930826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca352-9716-49a7-95ad-2f198041bc43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.943260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ca352-9716-49a7-95ad-2f198041bc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-6a6ca352-9716-49a7-95ad-2f198041bc43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:42.948150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:42.949061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:42.949934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 360/735] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:42.950606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb84f4-90d2-4d1b-8c51-90b90545f802 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:42.952023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb84f4-90d2-4d1b-8c51-90b90545f802 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:42.952023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb84f4-90d2-4d1b-8c51-90b90545f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:42.969126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-3ecb84f4-90d2-4d1b-8c51-90b90545f802 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:42.970367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3ecb84f4-90d2-4d1b-8c51-90b90545f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:43.027338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f5a4-96c4-4a11-b765-f3a70db6a067 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.041262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 361/736] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:43.043189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb2cf-29f2-4b55-aeb1-b584b10c1231 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.043610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb2cf-29f2-4b55-aeb1-b584b10c1231 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.044011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb2cf-29f2-4b55-aeb1-b584b10c1231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.064687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b10cb2cf-29f2-4b55-aeb1-b584b10c1231 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:43.067048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b10cb2cf-29f2-4b55-aeb1-b584b10c1231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:43.070667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.071289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.071575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.071846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.101484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.127381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.141593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 362/737] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:43.141593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb2cf-29f2-4b55-aeb1-b584b10c1231 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.149616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:43.151788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:43.242895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb2cf-29f2-4b55-aeb1-b584b10c1231 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.260872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 376/738] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:43.260872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.288242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.289139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.289638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.290125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.291056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:43.291546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:43.293153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:43.308924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 363/739] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:43.308924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.337993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.367697 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.379039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576f067-2671-4d4c-a563-57f55ef69321 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.413661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb2fd-3b70-42a6-829d-2210eaa26cd9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.414838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.415708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.416221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.416502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.417188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:43.418578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:43.448424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.449066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.449353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.449665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.459514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:43.464845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:43.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 364/740] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:43.467428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.484164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 377/741] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:36:43 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:43.485422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.583256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202418-6fb2-4dce-a4ea-15a220519271 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.601613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.613817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe211-4055-47d1-a05e-b12f0e9dc683 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.622144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.623110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.623549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.623982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.635156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.639967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:43.641776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:43.655746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.656454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.656688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.656941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:43.658408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:43.659264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:43.660192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:43.660192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:43.660192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:43.660192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:43.660192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 365/742] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:43.660847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.675164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:43.676761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:43.695410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:43.696339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:43.697222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:43.697222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:43.697222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:43.697222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:43.697962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 378/743] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:43.698756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.790874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a42d18-dbc7-404d-bc33-abfc95ea5298 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.835541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.836097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.836384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.836667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.837393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:43.837749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:43.839548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0759f47-cdf2-4eed-8f6a-6fb9da2e166f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:43.839831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:43.851278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 366/744] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:43.852138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.884753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.888010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:43.888930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.889711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.890182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.891848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:43.899699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:43.899699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:43.910934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 379/745] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:43.912045 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.944371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.972281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ee00c-3f97-4df5-975a-fc1f5f384767 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.011598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.012487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.012841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.013193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.013992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:44.014467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.016299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.037678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 367/746] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:44.038822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.044000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde8b9-a1f0-4a40-a9a1-d9f44ab4c7cb None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.089898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.090531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.090770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.090995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.104121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.106216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:44.126798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:44.127742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:44.129184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:44.129184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:44.129184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:44.129184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:44.135715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 380/747] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:44.136760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.163364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.177545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde2658-deda-4f1d-a0f4-17febfb8d195 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.223838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.224514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.224805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.225084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.228511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.232290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.233818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:44.245673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:44.254943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:44.255843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 368/748] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:44.256331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb900-c65e-4d6a-b0ac-8110df9bd5cc None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.256411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.295705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09de66f-a3d7-4a64-a4f0-8421cb1fc9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.296509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de66f-a3d7-4a64-a4f0-8421cb1fc9f5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.296775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de66f-a3d7-4a64-a4f0-8421cb1fc9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.297140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de66f-a3d7-4a64-a4f0-8421cb1fc9f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.305791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09de66f-a3d7-4a64-a4f0-8421cb1fc9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.307503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09de66f-a3d7-4a64-a4f0-8421cb1fc9f5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e09de66f-a3d7-4a64-a4f0-8421cb1fc9f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:44.319843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:44.320840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:44.321822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 381/749] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:44.322408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd8031-4769-47f2-afe6-197b351e3f58 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.323095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd8031-4769-47f2-afe6-197b351e3f58 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.323095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd8031-4769-47f2-afe6-197b351e3f58 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.328307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 382/750] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:44.329056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd8031-4769-47f2-afe6-197b351e3f58 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.367408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d724f-be03-4111-ab9d-9a4bef8a6663 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.401845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.402467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.402748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.403019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.403699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:44.403999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.405367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.417150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 369/751] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:44.417965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.431949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.443701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd8031-4769-47f2-afe6-197b351e3f58 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.480558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391929-2112-415e-88d7-fbc4a690259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.481178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391929-2112-415e-88d7-fbc4a690259c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.481445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391929-2112-415e-88d7-fbc4a690259c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.481761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391929-2112-415e-88d7-fbc4a690259c None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.482594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391929-2112-415e-88d7-fbc4a690259c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:44.482808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391929-2112-415e-88d7-fbc4a690259c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.484228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391929-2112-415e-88d7-fbc4a690259c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.493580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.497267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 383/752] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:44.498480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c404-8725-4020-a131-9a98961643f4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.498770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c404-8725-4020-a131-9a98961643f4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.499047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c404-8725-4020-a131-9a98961643f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.521152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-dd23c404-8725-4020-a131-9a98961643f4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:44.522358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-dd23c404-8725-4020-a131-9a98961643f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:44.534643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfbb61-4f07-4bb3-98eb-1bcce59def41 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.573036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.573907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.574342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.574618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.575634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:44.575942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.577482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.593579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 384/753] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:44.593579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c404-8725-4020-a131-9a98961643f4 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.601276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 370/754] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:44.602656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.677078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.705925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c404-8725-4020-a131-9a98961643f4 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.712767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fd3d3-a666-4a03-80a1-34b7707993a4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.735451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.741694 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.742436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.742721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.742994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.750481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.750819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.751440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.751723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.751929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.752030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.752771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=159e2784eaf44126b4e04dacbb328add) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:44.753156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.754745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:44.764371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:44.765408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:44.766542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:44.767173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 371/755] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/role_assignments?user.id=159e2784eaf44126b4e04dacbb328add&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:44.767173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.768607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 385/756] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:44.770180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:44.887351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950274f0-9171-47a3-910c-63c3184c2a9b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.894268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c01e3-3094-45e1-b93f-70ee2497d177 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.925235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.926648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.927253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.928408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.928408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.929613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.929939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.934793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.935423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.935778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.936040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:44.940681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:44.941958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:44.942779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:44.950318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 386/757] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:44.950318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.014921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.032214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.033891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.065999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9b46-f82f-4d72-ac05-d21393e5eeed None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.103106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.104505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.104967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.105392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.106439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:45.106889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.108723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.128632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 387/758] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:45.129866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.146878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 372/759] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:36:45.147778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.179480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.242380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3d5eb-e1b8-4383-a534-251b6d7189e6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.257790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.272391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b565c3f-6f6b-412c-9282-5a7aaf59e0dc None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.288407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.289267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.289981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.290119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.291096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:45.291481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.293014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.299418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 388/760] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:45.300452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.318918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.320110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.320579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.321039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.335794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.338255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:45.359278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:45.360221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:45.361097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:45.361097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:45.361097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:45.361097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:45.363133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 373/761] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:45.363653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.429669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce0b4-e415-456f-b42f-b5166a42ec1f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.459641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.472262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.472973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.473262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.473713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.482397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb242-34a0-4786-96c8-6bed5c470b89 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.485043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.486610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:45.505257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:45.506194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:45.507060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:45.507060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:45.507060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:45.507060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:45.507060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 389/762] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:45.507743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.531137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.532605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.533115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.533919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.535016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:45.535536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.537682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.539049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.546691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 374/763] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:45.551924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.621062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56c179-238f-4fd2-a6c0-6a7e67f4c215 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.658400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.659024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.660986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.660986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.662416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:45.662725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.664107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.673583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305485ce-88f2-4757-9b5d-e4704d30f8b5 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.682766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 390/764] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:45.682766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.711992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230b2b4-320a-42ee-8590-fb6e1947b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.712611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230b2b4-320a-42ee-8590-fb6e1947b281 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.712891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230b2b4-320a-42ee-8590-fb6e1947b281 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.713165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230b2b4-320a-42ee-8590-fb6e1947b281 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.713899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230b2b4-320a-42ee-8590-fb6e1947b281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:45.714201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230b2b4-320a-42ee-8590-fb6e1947b281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.715555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230b2b4-320a-42ee-8590-fb6e1947b281 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.736600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 375/765] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:45.738408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c4db-75bd-4ec9-a116-696a1451972c None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.738920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c4db-75bd-4ec9-a116-696a1451972c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.739378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c4db-75bd-4ec9-a116-696a1451972c None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.742165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 376/766] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:45.743114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635c4db-75bd-4ec9-a116-696a1451972c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.757861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.782891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.795877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ad266-d3e9-432b-87b5-dac71ebeaace None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.830820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.831968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.832255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.832527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.833277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] RBAC: Adding query filter params (interface=public, service_id=30967e54945a43bbb438c997d4bcaae6, region_id=RegionOne) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:45.833614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.834984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.846919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 391/767] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/endpoints?service_id=30967e54945a43bbb438c997d4bcaae6&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:45.846919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:45.870214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635c4db-75bd-4ec9-a116-696a1451972c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.909568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0e4a4-9649-4861-9b1d-bfc4fbb8a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.910910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0e4a4-9649-4861-9b1d-bfc4fbb8a762 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.911201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0e4a4-9649-4861-9b1d-bfc4fbb8a762 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.911476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0e4a4-9649-4861-9b1d-bfc4fbb8a762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.921475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0e4a4-9649-4861-9b1d-bfc4fbb8a762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:45.923402 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0e4a4-9649-4861-9b1d-bfc4fbb8a762 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-e0d0e4a4-9649-4861-9b1d-bfc4fbb8a762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:45.938221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:45.939298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:45.940193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 377/768] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:45.941865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda730-2ea4-4158-a4d4-97e579faa4ba None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.941865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda730-2ea4-4158-a4d4-97e579faa4ba None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.941865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda730-2ea4-4158-a4d4-97e579faa4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.960925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e501a-c8b6-4676-8aac-fde645fc0fae None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:45.962864 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-95dda730-2ea4-4158-a4d4-97e579faa4ba None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:45.964821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-95dda730-2ea4-4158-a4d4-97e579faa4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:45.996013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:45.996653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.996943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.997226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.004418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.005899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:46.017210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:46.018107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:46.019575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 392/769] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:46.020048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.035461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.037156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.052177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 378/770] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:46.052177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda730-2ea4-4158-a4d4-97e579faa4ba None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.125653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395470-5bbe-471e-a820-9480f040b287 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.159866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.160476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.160756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.161032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.161710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.163067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.164780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda730-2ea4-4158-a4d4-97e579faa4ba None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.177544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 393/771] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:46.177544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.216941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.217677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.218062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.218458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.219335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:46.219747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.222694 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.241996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 379/772] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:46.243167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.275144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.310034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0364751-108d-4d1a-9002-ba2c21e2c60b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.311381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.354254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.354921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.355209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.355493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.356250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:46.356561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.358102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.369681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062970d-a1ab-4f80-aa9e-6880991a04ff None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.370962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 394/773] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:46.371602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.416827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.417486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.417809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.418090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] PATH_INFO: `/v3/services/network` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.418789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.420731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:46.432940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:46.434235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:46.435272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:46.437664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 380/774] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:46.438640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.508071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10129b5-f8ae-47f6-8f88-cd51f23edb3e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.550741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362f5e8-e6f2-4905-a5e0-3eab2f7215fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.551673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f5e8-e6f2-4905-a5e0-3eab2f7215fa None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.551980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f5e8-e6f2-4905-a5e0-3eab2f7215fa None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.552262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f5e8-e6f2-4905-a5e0-3eab2f7215fa None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/784ac400fc5643a589d79d0314ee4a19/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.555161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362f5e8-e6f2-4905-a5e0-3eab2f7215fa None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=784ac400fc5643a589d79d0314ee4a19, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.557162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362f5e8-e6f2-4905-a5e0-3eab2f7215fa None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.560772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c3b9e-5eac-4a5b-bcbd-d88105234cb7 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.561640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.585845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.597711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.598340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.598624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.598901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.599690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=192c96d090b948d38f6becdb8ce42c83) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:46.600003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.601447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.610330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 381/775] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/role_assignments?user.id=192c96d090b948d38f6becdb8ce42c83&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:46.610330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.673953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 395/776] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:46 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/784ac400fc5643a589d79d0314ee4a19/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:46.796094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcc177-2fd6-4862-a0e7-6197c7569055 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.825066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5558-d072-4af7-a867-ffd8a449c7cf None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.825350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5558-d072-4af7-a867-ffd8a449c7cf None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.825660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5558-d072-4af7-a867-ffd8a449c7cf None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.827314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 396/777] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:46.833345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d786b6b-0c95-4bd5-891f-ccf093198857 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.833798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d786b6b-0c95-4bd5-891f-ccf093198857 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.833977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d786b6b-0c95-4bd5-891f-ccf093198857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.836297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.836992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.837290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.837598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.838299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] RBAC: Adding query filter params (name=network) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:46.838609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.841969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.849199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 382/778] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:46.855127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.860451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0d786b6b-0c95-4bd5-891f-ccf093198857 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:46.861706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0d786b6b-0c95-4bd5-891f-ccf093198857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:46.929891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.995984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26aedc-a39e-4297-9b1b-d5d12082600c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.002785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 397/779] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:36:47.027415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d786b6b-0c95-4bd5-891f-ccf093198857 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:47.068373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.069050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.069401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.070009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.071373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] RBAC: Adding query filter params (type=network) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:47.072922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:47.074657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:47.087690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 383/780] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:47.096387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:47.231401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d786b6b-0c95-4bd5-891f-ccf093198857 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.251088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b4e47-849f-489a-92e4-32d953c91952 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.268611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:47.299150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:47.307715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.308672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.309120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.309583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.310871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] RBAC: Adding query filter params (interface=public, service_id=6c942eb7ad5e4b03bcc8ff1e5d35b45e, region_id=RegionOne) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:47.311367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:47.313207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:47.323156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.323725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.324125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.324350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.324533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 384/781] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:36:47 2022] GET /identity/v3/endpoints?service_id=6c942eb7ad5e4b03bcc8ff1e5d35b45e&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:47.329605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:47.360331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:47.365957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:47.367142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:47.368064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:47.374056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 398/782] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:47.381810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:47.447406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c218-4e54-4d84-951b-09dba8854973 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.490676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.491316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.491600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.491878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.492536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:47.493945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:47.507439 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 385/783] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:36:47 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:47.557703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b205db6-a764-4f42-8528-ea93a46bff3f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.608221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.609189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.609708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.610218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.611172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:47.611690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:47.613465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:47.623575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 399/784] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:47.630203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:47.691173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:47.752037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab327e0-3d9d-473f-a953-e077e4b734b8 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.791946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.792735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.793125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.793504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.805277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:47.807257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:47.823231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:47.824317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:47.825383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:47.825383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:47.825383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:47.825383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:47.826939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 386/785] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:47.832771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:47.886605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:47.940792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb8030-7af1-4cbb-a844-b85d849c7252 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.978801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.979539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.979831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.980114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.980816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:47.981129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:47.982559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:47.996518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 400/786] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:48.002001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:48.124530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:48.132480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e612-7a41-48b6-a690-d2a29dfcf295 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:48.179367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:48.179939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:48.180219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:48.180494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:48.195145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:48.196603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:48.211641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:48.212580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:48.213505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 387/787] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:48.220395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:48.383615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca5ef-142d-43a2-ba20-87896e38cdda None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:48.403441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:48.445713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78344c0-e72c-4e00-948b-9e8b7a31b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:48.446257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78344c0-e72c-4e00-948b-9e8b7a31b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:48.446544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78344c0-e72c-4e00-948b-9e8b7a31b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:48.446825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78344c0-e72c-4e00-948b-9e8b7a31b3e9 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:48.447621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78344c0-e72c-4e00-948b-9e8b7a31b3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:48.447931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78344c0-e72c-4e00-948b-9e8b7a31b3e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:48.452656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78344c0-e72c-4e00-948b-9e8b7a31b3e9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:48.480325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 401/788] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 1 15:36:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:48.485865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:48.538302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23dea0-3e02-4612-a7f1-13744f7119ad None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:48.538565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23dea0-3e02-4612-a7f1-13744f7119ad None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:48.538845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23dea0-3e02-4612-a7f1-13744f7119ad None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:48.540323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 402/789] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:48.551242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec28f5-e734-4034-87f8-1c8e56e34248 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:48.551832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec28f5-e734-4034-87f8-1c8e56e34248 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:48.552320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec28f5-e734-4034-87f8-1c8e56e34248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:48.588889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4aec28f5-e734-4034-87f8-1c8e56e34248 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:48.590101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4aec28f5-e734-4034-87f8-1c8e56e34248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:48.633194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830549-9438-4d38-83aa-93fd5b8a7ed2 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:48.699816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:48.700399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:48.700674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:48.701436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:48.717556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 403/790] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:36:48.721398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:48.722934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:48.739790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec28f5-e734-4034-87f8-1c8e56e34248 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:48.757319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:48.758305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:48.759204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:48.759204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:48.759204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:48.759204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:48.761458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 388/791] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:48.764470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:48.785121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:48.908086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:48.918135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec28f5-e734-4034-87f8-1c8e56e34248 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:48.947719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16568d-641e-46f7-a2f8-709c20482268 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:48.979024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:48.979593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:48.981027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:48.981314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:48.983992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:48.985441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:48.999203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:49.000182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:36:49.001030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:49.005607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 404/792] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Aug 1 15:36:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:49.010387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.011207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.012447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.012732 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.013007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.013729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:49.014036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:49.015417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:49.041916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 389/793] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:49.047227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.163738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.186584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ede39-5669-4993-9bda-be5dc00b298d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:49.201553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ca311-e8ed-4015-838c-70f12466038d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:49.224645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eecc5-4fad-4950-9a4b-92bc3c93ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.225275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eecc5-4fad-4950-9a4b-92bc3c93ea03 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.225610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eecc5-4fad-4950-9a4b-92bc3c93ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.225892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eecc5-4fad-4950-9a4b-92bc3c93ea03 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.227099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eecc5-4fad-4950-9a4b-92bc3c93ea03 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:49.227414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eecc5-4fad-4950-9a4b-92bc3c93ea03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:49.229142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eecc5-4fad-4950-9a4b-92bc3c93ea03 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:49.235912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 405/794] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:49.238058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446d635-c237-4428-8234-31b14dd2ccbe None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.238355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446d635-c237-4428-8234-31b14dd2ccbe None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.238744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446d635-c237-4428-8234-31b14dd2ccbe None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.240782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 406/795] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:49.241874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446d635-c237-4428-8234-31b14dd2ccbe None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.242082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afd181-558f-4b6c-b084-0eb1d0d4b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.242810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd181-558f-4b6c-b084-0eb1d0d4b53d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.243167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd181-558f-4b6c-b084-0eb1d0d4b53d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.243510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd181-558f-4b6c-b084-0eb1d0d4b53d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.253088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd181-558f-4b6c-b084-0eb1d0d4b53d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:49.255152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd181-558f-4b6c-b084-0eb1d0d4b53d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-29afd181-558f-4b6c-b084-0eb1d0d4b53d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:49.270150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:49.271557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:49.272644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:49.273294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.273428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 390/796] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:49.279864 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f7688-ca1b-4f80-8375-8d29c7854a02 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.281858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f7688-ca1b-4f80-8375-8d29c7854a02 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.281858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f7688-ca1b-4f80-8375-8d29c7854a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.299809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b45f7688-ca1b-4f80-8375-8d29c7854a02 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:49.301000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b45f7688-ca1b-4f80-8375-8d29c7854a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:49.361344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446d635-c237-4428-8234-31b14dd2ccbe None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:49.375427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 391/797] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:49.376911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7607-98fc-40b7-9c29-591992f4a5a2 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.377411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7607-98fc-40b7-9c29-591992f4a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.378521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7607-98fc-40b7-9c29-591992f4a5a2 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.380224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 392/798] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:49.381086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7607-98fc-40b7-9c29-591992f4a5a2 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.409458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c002-04c9-410a-9709-f386bde46137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.410476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c002-04c9-410a-9709-f386bde46137 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.410771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c002-04c9-410a-9709-f386bde46137 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.411206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c002-04c9-410a-9709-f386bde46137 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.412213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8c002-04c9-410a-9709-f386bde46137 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:49.412528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8c002-04c9-410a-9709-f386bde46137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:49.414069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8c002-04c9-410a-9709-f386bde46137 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:49.419668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 407/799] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:49.424577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176a87-929c-436c-a34c-73e4f4107bc2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.424577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176a87-929c-436c-a34c-73e4f4107bc2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.424577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176a87-929c-436c-a34c-73e4f4107bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.441965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-bc176a87-929c-436c-a34c-73e4f4107bc2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:49.443169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bc176a87-929c-436c-a34c-73e4f4107bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:49.451667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.500412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7607-98fc-40b7-9c29-591992f4a5a2 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:49.513609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 408/800] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:49.514799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc176a87-929c-436c-a34c-73e4f4107bc2 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.539735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.546157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.546976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.547409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.547832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.548747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:49.549225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:49.551302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:49.564332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 393/801] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:49.565204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.633117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc176a87-929c-436c-a34c-73e4f4107bc2 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:49.669538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.670213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.670494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.670771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.674436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54eb0-bd17-495e-aee4-a80f2d82c70d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:49.685411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:49.690922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:49.691925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:49.692784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 409/802] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:49.693477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.694566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.716033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.717231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.717738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.718470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.719818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:49.722472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:49.780995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.802455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2acb-36b8-41be-b85b-e1849b7f8447 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:49.820950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 394/803] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:36:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:49.822129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.848660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:49.849383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.849698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.849971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.867199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:49.872336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:49.873304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:49.874537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:49.879469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 410/804] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:49.880451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.969046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60ac7a-0992-4f6d-9c76-be1127ca84f0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.008335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.009021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.009421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.009744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/159e2784eaf44126b4e04dacbb328add/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.011870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=159e2784eaf44126b4e04dacbb328add, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.013583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.027597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254b4ba-a543-4e59-8b16-b9ca2a2776aa None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.064526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.065064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.065399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.066232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.066900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:50.067203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.068832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.070129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.077876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 395/805] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:49 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/159e2784eaf44126b4e04dacbb328add/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:50.083358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 411/806] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:50.084016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.084558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.132704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.218679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f96b5-a01d-4394-a46b-56ef6b19b9e7 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.219958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d2c5-71bc-4b7e-a75b-d2396ff8d9a3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.257920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ca0b1-35f1-4184-9175-028b19706a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.258959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca0b1-35f1-4184-9175-028b19706a17 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.259448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca0b1-35f1-4184-9175-028b19706a17 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.259925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca0b1-35f1-4184-9175-028b19706a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.261212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1a64-66e5-4fce-80b2-a46a9fc2259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.261880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1a64-66e5-4fce-80b2-a46a9fc2259f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.262169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1a64-66e5-4fce-80b2-a46a9fc2259f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.262505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1a64-66e5-4fce-80b2-a46a9fc2259f None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.263234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1a64-66e5-4fce-80b2-a46a9fc2259f None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:50.263546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1a64-66e5-4fce-80b2-a46a9fc2259f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.264942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1a64-66e5-4fce-80b2-a46a9fc2259f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.273151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ca0b1-35f1-4184-9175-028b19706a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.273638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 396/807] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:50.277062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368f1b-1bd2-47cf-80a0-43a091fdce1e None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.277062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368f1b-1bd2-47cf-80a0-43a091fdce1e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.277062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368f1b-1bd2-47cf-80a0-43a091fdce1e None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.277062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 397/808] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:50.281143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ca0b1-35f1-4184-9175-028b19706a17 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.281611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368f1b-1bd2-47cf-80a0-43a091fdce1e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e11ca0b1-35f1-4184-9175-028b19706a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:50.302108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:50.303018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:50.303883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:50.303883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:50.303883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:50.303883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:50.305793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 412/809] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:50.307522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ecacc-032d-4f17-a6ed-995fcdc3eb6b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.308013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ecacc-032d-4f17-a6ed-995fcdc3eb6b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.308488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ecacc-032d-4f17-a6ed-995fcdc3eb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.327473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1d6ecacc-032d-4f17-a6ed-995fcdc3eb6b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:50.328966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1d6ecacc-032d-4f17-a6ed-995fcdc3eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:50.378680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.401692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.403409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 413/810] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:50.404418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ecacc-032d-4f17-a6ed-995fcdc3eb6b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.423361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368f1b-1bd2-47cf-80a0-43a091fdce1e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.476077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.476728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.477076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.477357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.488602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.490169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:50.506529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:50.507859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:50.508884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:50.508884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:50.508884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:50.508884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:50.508884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 398/811] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:50.508884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.518006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ecacc-032d-4f17-a6ed-995fcdc3eb6b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.553369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.554020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.554308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.554571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.555270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:50.555577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.557218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.569026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 414/812] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:50.569881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.610763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.623233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c20ec-2613-40e4-9669-9a240311bdc7 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.662110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.663127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.663826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.664123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.665097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.667359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.673384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704f2b-3806-4991-ab0b-19f6818903d9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:50.679959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:50.682468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:36:50.683605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:50.688385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 399/813] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:50.688385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.705683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.718033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.718753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.719560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.719560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.720265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:50.720669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.722824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.736010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 415/814] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:50.737099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.832207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ba31-5975-42f9-8360-461cf897d0d7 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.852147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.856083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08338871-d38b-4205-872e-c745f258cb84 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.877034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.878110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.878401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.878818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.890260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.891767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.892743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.894099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.894487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.894952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.895726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] RBAC: Adding query filter params (name=network) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:50.896129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.897635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.902873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 416/815] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:50.903736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:50.904879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:50.906009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:36:50.907236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:50.911453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 400/816] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:50.913123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:50.985487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:51.016742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb2813-92a3-4d2b-96ba-2a56b5b647ce None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.043412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf7251-5cd7-4b69-8c01-b8131f509e2c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.054872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.055767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.056522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.056999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.057931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] RBAC: Adding query filter params (type=network) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:51.058492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.060150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.065593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 401/817] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:51.066648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.085500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.086193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.086545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.086754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.095040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.097095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:51.109783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:51.110770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:51.111697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 417/818] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:36:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:51.112314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.138527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:51.191893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e94793-445f-44c6-b22a-09c48e07d3de None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.223953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa834-0793-43cd-9820-db0af1eb40c9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.230551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.231450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.231964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.232482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.233545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:51.234059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.235700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.237719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:51.256992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 402/819] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:36:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:51.258439 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.260963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.261690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.262037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.262941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.263155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.264636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.370324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743b2ba-493e-42fe-a7ad-38e4480d77ff None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.387308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 418/820] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:36:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:51.388465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.436422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.438450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.438737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.439169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.441919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:51.442157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.444368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.486969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 403/821] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 1 15:36:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:51.494252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.544702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:51.561993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:51.578542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80bf5-7e71-445c-87be-4a8bd1495b36 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.613279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.614268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.614937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.615410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.619796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d0632-f776-4612-afaa-1b8cec76db7b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.657867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.658662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.658995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.659833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.672391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.674128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.691057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:51.691493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:51.692333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:51.693651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:51.693651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:51.693651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:51.693651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:51.693651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 404/822] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:51.695504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.699332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.775652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:51.805159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 419/823] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:36:51.810861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.822218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576e271-c3c7-49d7-bd44-fb5d93641823 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.825962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:51.867485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.868123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.868419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.869155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:51.869404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:51.869737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:51.871130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:51.892123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 405/824] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:51.893213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:51.945427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13bb4b-ea81-40b9-aa63-5e5cda821f2b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:51.989924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:51.990945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:51.991558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:51.992411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.005757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.007882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.011218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a2135-15d5-455b-bf89-eb5aef5a5ebd None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:52.027193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:52.028160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:52.029009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:52.029009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:52.029009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:52.029009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:52.031490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 420/825] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:52.041631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.058798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.059704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.060055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.060402 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.068711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.070304 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.077720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:52.084695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:52.085652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:52.086533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:52.091040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 406/826] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:52.098141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.112293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.163365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eadb85-78f1-4cb6-8bc7-9e558dbed8e7 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.197115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13528-35d7-43d1-b8b9-9787b96f24c3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.199391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d2a0c-bcf3-4fbc-846f-105a497fdf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.200406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2a0c-bcf3-4fbc-846f-105a497fdf0d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.200406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2a0c-bcf3-4fbc-846f-105a497fdf0d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.200585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2a0c-bcf3-4fbc-846f-105a497fdf0d None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.201278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d2a0c-bcf3-4fbc-846f-105a497fdf0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:52.201616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d2a0c-bcf3-4fbc-846f-105a497fdf0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.203002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d2a0c-bcf3-4fbc-846f-105a497fdf0d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.217221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 421/827] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:52.218334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bfe7-23b0-4f42-a95d-b5680fcd7a66 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.218630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bfe7-23b0-4f42-a95d-b5680fcd7a66 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.218898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bfe7-23b0-4f42-a95d-b5680fcd7a66 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.220235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 422/828] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:52.224820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bfe7-23b0-4f42-a95d-b5680fcd7a66 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.238477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86597b89-d6f4-4f8f-b6d1-b8312095f19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.239101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597b89-d6f4-4f8f-b6d1-b8312095f19b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.239407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597b89-d6f4-4f8f-b6d1-b8312095f19b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.239686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597b89-d6f4-4f8f-b6d1-b8312095f19b None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.240450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86597b89-d6f4-4f8f-b6d1-b8312095f19b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:52.240754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86597b89-d6f4-4f8f-b6d1-b8312095f19b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.242237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86597b89-d6f4-4f8f-b6d1-b8312095f19b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.254822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 407/829] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:36:52.255990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c581-fabe-45d5-9a97-cae19b7199c7 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.256276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c581-fabe-45d5-9a97-cae19b7199c7 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.256559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c581-fabe-45d5-9a97-cae19b7199c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.273742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d860c581-fabe-45d5-9a97-cae19b7199c7 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:52.274948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d860c581-fabe-45d5-9a97-cae19b7199c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:52.319985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.330195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bfe7-23b0-4f42-a95d-b5680fcd7a66 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.345800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 408/830] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:52.347094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c943a3-78bd-4bb2-adf8-e8d7a8b88c80 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.347386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c943a3-78bd-4bb2-adf8-e8d7a8b88c80 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.347656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c943a3-78bd-4bb2-adf8-e8d7a8b88c80 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.349045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 409/831] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:52.349554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c943a3-78bd-4bb2-adf8-e8d7a8b88c80 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.361355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.365675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428cc9-92af-4fd0-8e18-0afafb4185cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.366375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428cc9-92af-4fd0-8e18-0afafb4185cd None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.366670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428cc9-92af-4fd0-8e18-0afafb4185cd None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.366968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428cc9-92af-4fd0-8e18-0afafb4185cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.374841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf428cc9-92af-4fd0-8e18-0afafb4185cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.376392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf428cc9-92af-4fd0-8e18-0afafb4185cd None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-bf428cc9-92af-4fd0-8e18-0afafb4185cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:52.388043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:52.389800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:52.390680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 423/832] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:52.391177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf13b4-af57-46e3-a4ed-ea64a607d202 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.391177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf13b4-af57-46e3-a4ed-ea64a607d202 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.391321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf13b4-af57-46e3-a4ed-ea64a607d202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.408418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2bbf13b4-af57-46e3-a4ed-ea64a607d202 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:52.409673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2bbf13b4-af57-46e3-a4ed-ea64a607d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:52.454585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c943a3-78bd-4bb2-adf8-e8d7a8b88c80 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.475509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 424/833] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:52.476373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf13b4-af57-46e3-a4ed-ea64a607d202 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.491944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.492747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.493135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.493534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/192c96d090b948d38f6becdb8ce42c83/roles/29678fc410464c378e9689814592e7b2` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.511288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=192c96d090b948d38f6becdb8ce42c83, role_id=29678fc410464c378e9689814592e7b2)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.512765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.556266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.574901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf13b4-af57-46e3-a4ed-ea64a607d202 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.607573 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.608208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.608493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.608771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.609400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.610868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:52.620151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:52.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:52.622335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 425/834] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:52.623143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.635469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 410/835] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:36:52 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/192c96d090b948d38f6becdb8ce42c83/roles/29678fc410464c378e9689814592e7b2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:36:52.636296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.704716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.746027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7113c33-1aff-4f18-916b-c2fa2ba491b3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.752316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97016-32fa-48fb-a414-ad4f5e6514d4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.785057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.786089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.786618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.787080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.788017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:52.788522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.790120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.797757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.798633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.799342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.801018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.804235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 426/836] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:52.805037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.810979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.813487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:52.818478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:52.819617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:52.820472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 411/837] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:52.821169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.917473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f319ed-abe5-4608-8215-a3dfe1d77942 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.931626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07acb41-5f4a-492f-9d53-15100544b79d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:52.949817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.954155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.954829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.955057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.955331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.958630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:52.958937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.963737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.965048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 427/838] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:52.965874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.973328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:52.974099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.974387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.974667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.975464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=784ac400fc5643a589d79d0314ee4a19) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:52.975775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:52.977359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:52.990003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 412/839] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/role_assignments?user.id=784ac400fc5643a589d79d0314ee4a19&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:52.990708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:53.052519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:53.093954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7e272-ad37-4930-ab85-fae3bf6b3d48 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:53.117247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a401a-36c7-4a75-a69c-d90d9ab8d7c4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:53.139105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:53.139729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:53.140009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:53.140281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:53.141010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:53.141299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:53.142708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:53.157301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 428/840] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:53.165181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:53.165983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:53.166339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:53.166713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:53.167265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:53.167442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:53.167707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:53.169100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:53.180233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 413/841] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:53.295616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f900d-f5c8-4505-b867-abf153f92097 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:53.331982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:53.332637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:53.332918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:53.333187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:53.334125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:53.347488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:53.348983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:53.364041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:53.365051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:53.366279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:53.366279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:53.366279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:53.366279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:53.366279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 429/842] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:53.372548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:53.424791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:53.480693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb34b63-05a7-4156-a293-5171822b0cbe None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:53.516039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:53.516662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:53.516942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:53.517214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:53.517957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:53.518905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:53.520413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:53.533556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 414/843] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:53.539407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:53.651811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929d321-a375-4bff-a38d-a96f6c2594d4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:53.687212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:53.688237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:53.688729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:53.689230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:53.697975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:53.699701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:53.712437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:53.713416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:36:53.714411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:53.721343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 430/844] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:36:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:53.726648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:53.841593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acedde5-a918-476f-b83a-599fca59d151 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:53.849465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:53.877384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:53.878720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:53.879023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:53.879353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:53.880146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:53.880452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:53.882113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:53.900718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 415/845] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 1 15:36:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:53.906429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:53.953384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:54.013114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b827a-810a-4aa0-b65c-1e1dbe79ce8e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:54.047234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:54.047863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:54.048150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:54.048433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:54.119065 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:54.120541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:54.169947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:54.229285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 431/846] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:36:54.234668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:54.342504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd5aa-56fc-4adc-956a-7ee0e4f0ba1e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:54.379902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:54.380565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:54.380850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:54.381125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:54.392187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:54.393788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:54.408622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:54.410087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:54.410974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:54.410974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:54.410974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:54.410974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:54.410974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 416/847] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:54.416121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:54.521371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acbc50-eba1-42f6-b7dc-d9ab463f8060 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:54.558192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:54.558813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:54.559149 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:54.559434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:54.560126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:54.560434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:54.561861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:54.578565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 432/848] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:54.582580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:54.606109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:54.686123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc120f26-1c6f-45fa-bbd4-1ea5c87c7b93 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:54.725880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e183d7-5c8d-4d99-a913-34e606ab5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:54.726524 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e183d7-5c8d-4d99-a913-34e606ab5d20 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:54.726805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e183d7-5c8d-4d99-a913-34e606ab5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:54.727354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e183d7-5c8d-4d99-a913-34e606ab5d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:54.733996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e183d7-5c8d-4d99-a913-34e606ab5d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:54.735446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e183d7-5c8d-4d99-a913-34e606ab5d20 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-07e183d7-5c8d-4d99-a913-34e606ab5d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:54.747099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:54.748320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:54.749617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 417/849] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:54.756325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:54.759837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:54.777761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4e67-be76-4e6d-b26e-8a69fa415e35 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:54.778058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4e67-be76-4e6d-b26e-8a69fa415e35 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:54.778226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4e67-be76-4e6d-b26e-8a69fa415e35 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:54.779825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 418/850] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:54.785456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baedf7-ea0a-473c-8b0d-984911c58f69 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:54.785795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baedf7-ea0a-473c-8b0d-984911c58f69 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:54.786077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baedf7-ea0a-473c-8b0d-984911c58f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:54.804477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-44baedf7-ea0a-473c-8b0d-984911c58f69 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:54.805730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-44baedf7-ea0a-473c-8b0d-984911c58f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:54.871619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924348a-4b51-463e-b05c-94a2be3850b4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:54.885595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 419/851] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:36:54.904607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baedf7-ea0a-473c-8b0d-984911c58f69 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:54.918732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:54.919926 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:54.920895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:54.921375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:54.921893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:54.922763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:54.923249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:54.925292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:54.942080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 433/852] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:54.949211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.031771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:55.033540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baedf7-ea0a-473c-8b0d-984911c58f69 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.072689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.073450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.073882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.074249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.084605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d6ef-6e15-402f-8853-350acc81d486 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.086384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:36:55.091506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:55.092425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:36:55.093254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:55.097706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 420/853] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:55.099056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.131429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2f4de-5146-468f-bf5f-dfcc26fd5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.132051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f4de-5146-468f-bf5f-dfcc26fd5dff None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.132337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f4de-5146-468f-bf5f-dfcc26fd5dff None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.132617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f4de-5146-468f-bf5f-dfcc26fd5dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.133404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2f4de-5146-468f-bf5f-dfcc26fd5dff None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=159e2784eaf44126b4e04dacbb328add) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:55.133763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2f4de-5146-468f-bf5f-dfcc26fd5dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.135231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2f4de-5146-468f-bf5f-dfcc26fd5dff None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.149805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 434/854] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:54 2022] GET /identity/v3/role_assignments?user.id=159e2784eaf44126b4e04dacbb328add&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:55.166031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6ea0-0580-4833-8e68-8d02972b1272 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.166364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6ea0-0580-4833-8e68-8d02972b1272 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.166604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6ea0-0580-4833-8e68-8d02972b1272 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.172300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 435/855] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:55.173806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc38ee-7b3d-4fc5-9ca7-4c1aab053199 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.174154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc38ee-7b3d-4fc5-9ca7-4c1aab053199 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.174483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc38ee-7b3d-4fc5-9ca7-4c1aab053199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.179501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:55.194294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e8fc38ee-7b3d-4fc5-9ca7-4c1aab053199 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:55.195607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e8fc38ee-7b3d-4fc5-9ca7-4c1aab053199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:55.231056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9284b8-deac-4dfe-b244-21322db9e7a9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.277688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 436/856] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:55.287011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef0706-6279-4907-886c-023ac3dd57ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.287583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef0706-6279-4907-886c-023ac3dd57ae None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.287863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef0706-6279-4907-886c-023ac3dd57ae None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.288137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef0706-6279-4907-886c-023ac3dd57ae None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.288890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef0706-6279-4907-886c-023ac3dd57ae None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:55.289194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef0706-6279-4907-886c-023ac3dd57ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.290634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef0706-6279-4907-886c-023ac3dd57ae None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.299990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1d80-0037-45b3-813d-d399da688010 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.300304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1d80-0037-45b3-813d-d399da688010 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.300586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1d80-0037-45b3-813d-d399da688010 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.302526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 437/857] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:55.303629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 421/858] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:55.307337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e1d80-0037-45b3-813d-d399da688010 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.307933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740ea6-ebdb-4421-a6d6-97f8e02e199b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.308305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740ea6-ebdb-4421-a6d6-97f8e02e199b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.308584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740ea6-ebdb-4421-a6d6-97f8e02e199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.328392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-60740ea6-ebdb-4421-a6d6-97f8e02e199b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:55.329748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-60740ea6-ebdb-4421-a6d6-97f8e02e199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:55.378561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:55.401376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 422/859] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:55.406437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60740ea6-ebdb-4421-a6d6-97f8e02e199b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.435125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e1d80-0037-45b3-813d-d399da688010 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.472253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:55.476827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.477484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.477798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.478138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.478778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.480890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:55.491128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:55.496408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:55.497240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 438/860] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:55.498470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.521552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60740ea6-ebdb-4421-a6d6-97f8e02e199b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.558185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.559086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.559369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.559651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.571147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.572634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:55.591916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:55.592895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:55.593807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:55.593807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:55.593807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:55.593807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:55.593807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 423/861] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:55.594086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.606387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99abd5-a969-461d-ba50-b7b62c1cc308 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.628827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:55.643415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.644043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.644334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.644614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.645307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.646723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.706100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037bf34-fadc-41c1-8500-f452a3836960 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.716199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 439/862] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:36:55 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:36:55.717276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.722272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:55.753114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.753812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.754063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.754365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.755062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:55.755370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.756796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.762734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 424/863] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:55.770626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.884695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036962f-7724-43d0-8240-91954d7ad46e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.893310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d49a-5b38-4b68-9a89-7f2d0acaf179 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:55.936095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.936720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.936999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.937113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:55.937288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.937728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.937994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:55.938090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.938284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.938378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.938968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:55.939278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:55.939658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.940742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:55.951905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 425/864] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:55.956172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 440/865] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:55.962680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:56.010505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:56.088167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140483-b9c6-4046-ba60-77dd075eeb66 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:56.126929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:56.128143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:56.128420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:56.128692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:56.136756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:56.138211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:36:56.150050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:56.151214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:56.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 426/866] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:56.158866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:56.208175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:56.279557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6abff-c6a1-4f46-a1d1-d51bbaaeaa9c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:56.320408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:56.321132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:56.321486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:56.321860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:56.322740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:56.323118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:56.324624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:56.345228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 441/867] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 1 15:36:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:56.351642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:56.450858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:56.457483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1dd2a-106a-414f-a7f1-f1c8ddc8d6b2 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:56.492476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:56.493100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:56.493383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:56.493691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:56.566831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:56.569783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:56.666032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:56.674232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 427/868] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:36:56 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:36:56.679694 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:56.782279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:56.786298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040cc8-49ec-4c69-a973-05bf42eb5cb5 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:56.821620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:56.822271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:56.822553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:56.822827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:56.833487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:56.834968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:36:56.850638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:56.851574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:56.852495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:36:56.852495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:36:56.852495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:36:56.852495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:56.852495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 442/869] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:56.857825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:56.966881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5216e3d-8499-41f2-94b9-e6bd5b1da924 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:57.003013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:57.004000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.004564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.005068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.006029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:57.006566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:57.008148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:57.021592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 428/870] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:57.026804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:57.135592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2dbd3-3b13-418c-94f0-8669d07791a6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:57.173105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9bf6-83cd-4ac2-9661-5c8bf375bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:57.173787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9bf6-83cd-4ac2-9661-5c8bf375bb76 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.174072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9bf6-83cd-4ac2-9661-5c8bf375bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.174461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9bf6-83cd-4ac2-9661-5c8bf375bb76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.182049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f9bf6-83cd-4ac2-9661-5c8bf375bb76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:57.183494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f9bf6-83cd-4ac2-9661-5c8bf375bb76 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-685f9bf6-83cd-4ac2-9661-5c8bf375bb76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:36:57.195586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:57.196492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:57.197399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 443/871] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:57.202726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:57.261217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:57.269946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16d581-2df9-4a50-8291-930bfdfdcdbc None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.273862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16d581-2df9-4a50-8291-930bfdfdcdbc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.273862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16d581-2df9-4a50-8291-930bfdfdcdbc None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.273862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 444/872] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:57.277212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04006b8-883f-4f03-a82d-e6e7cc09ef95 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.277505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04006b8-883f-4f03-a82d-e6e7cc09ef95 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.277825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04006b8-883f-4f03-a82d-e6e7cc09ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.297742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d04006b8-883f-4f03-a82d-e6e7cc09ef95 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:57.298936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d04006b8-883f-4f03-a82d-e6e7cc09ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:57.302833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:57.312320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ce856-9243-413b-b2f2-f40ca0c118d4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:57.355072 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:57.355989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.356280 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.356561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.357369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:57.357718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:57.360403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:57.378518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 429/874] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:57.378869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 445/874] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:36:57.383665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:57.398380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04006b8-883f-4f03-a82d-e6e7cc09ef95 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:57.507950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04006b8-883f-4f03-a82d-e6e7cc09ef95 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:57.519891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a41e6-fba7-49fa-8181-aa328cae96a2 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:57.538254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:57.544719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:57.545685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.545914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.546287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.547168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:57.548708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:57.558972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:57.560171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:36:57.561080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:36:57.564356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:57.565332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.565615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 446/875] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:36:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:36:57.566066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.566539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.567661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=192c96d090b948d38f6becdb8ce42c83) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:57.568191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:57.568654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:57.570197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:57.572907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:57.578119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 430/876] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:36:57 2022] GET /identity/v3/role_assignments?user.id=192c96d090b948d38f6becdb8ce42c83&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:57.688147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47afe9-6584-4f8b-a31a-67af225bff03 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:57.725418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be117b9-4b39-4cfa-acbe-feca4f3bd926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:57.726078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be117b9-4b39-4cfa-acbe-feca4f3bd926 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.726365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be117b9-4b39-4cfa-acbe-feca4f3bd926 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.726640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be117b9-4b39-4cfa-acbe-feca4f3bd926 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.727336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be117b9-4b39-4cfa-acbe-feca4f3bd926 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:57.727642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be117b9-4b39-4cfa-acbe-feca4f3bd926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:57.729035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be117b9-4b39-4cfa-acbe-feca4f3bd926 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:57.740446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 447/877] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:36:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:57.743955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:57.850830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9d596-7728-4992-8189-1775296028ed None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:57.868533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96114fd5-2400-41a2-9b48-03b5bbc18d16 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.868961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96114fd5-2400-41a2-9b48-03b5bbc18d16 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.869069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96114fd5-2400-41a2-9b48-03b5bbc18d16 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.870585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 448/878] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:36:57.885977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d4b01-a4b5-4a94-96be-ff4b043ce9aa None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.886304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d4b01-a4b5-4a94-96be-ff4b043ce9aa None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.886540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d4b01-a4b5-4a94-96be-ff4b043ce9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.892864 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:57.894064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:57.894339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:57.894616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:57.895293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:57.895594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:57.896962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:57.902232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 431/879] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:36:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:57.913820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-655d4b01-a4b5-4a94-96be-ff4b043ce9aa None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:57.915050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-655d4b01-a4b5-4a94-96be-ff4b043ce9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:57.990366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:57.998103 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 449/880] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:58.025470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:58.085408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:58.104633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609ce3-ac2b-47f3-8792-752f23d86761 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.105136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609ce3-ac2b-47f3-8792-752f23d86761 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.105342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609ce3-ac2b-47f3-8792-752f23d86761 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.108205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 450/881] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:58.113418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edda03-693c-4910-9d52-84929a880bf4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.113854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edda03-693c-4910-9d52-84929a880bf4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.114180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edda03-693c-4910-9d52-84929a880bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.144361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a7edda03-693c-4910-9d52-84929a880bf4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:58.145580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a7edda03-693c-4910-9d52-84929a880bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:58.150096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e7ce4-8360-478f-b7ba-870cb3982526 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:58.240240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:58.240240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.240240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.240240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:58.240613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:36:58.241325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:36:58.242258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:36:58.243130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:36:58.243130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:36:58.243130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 432/882] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:36:58.243130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:58.243367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 451/883] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:58.247959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edda03-693c-4910-9d52-84929a880bf4 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:58.335294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7eea-8c8a-4d7e-9437-54764d9b9dfd None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:58.342756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:58.360830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edda03-693c-4910-9d52-84929a880bf4 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:58.370269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:58.371032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.371414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.371792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.372573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:58.372992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:58.374604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:58.385217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 433/884] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:58.386268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:58.394279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:58.403512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:58.404355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.408369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.408369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.408369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:58.408369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:58.498169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989419b0-03c8-47dc-9741-f168992bbd8f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:58.528189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 452/885] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:36:58 2022] POST /identity/v3/services => generated 269 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:36:58.550245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:58.551352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.551878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.552534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.553569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:58.554095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:58.557763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:58.563437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 434/886] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:36:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:58.569706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:58.690197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8336c-cc41-442c-b1f0-76abf32e6ebd None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:58.726175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42b58-95da-4f65-a38b-2cadeff2c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:58.727182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42b58-95da-4f65-a38b-2cadeff2c388 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.727669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42b58-95da-4f65-a38b-2cadeff2c388 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.728142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42b58-95da-4f65-a38b-2cadeff2c388 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.729121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42b58-95da-4f65-a38b-2cadeff2c388 None admin] RBAC: Adding query filter params (interface=public, service_id=a3abc219f1094f23a3ba182d96868361, region_id=RegionOne) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:36:58.729658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42b58-95da-4f65-a38b-2cadeff2c388 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:58.731247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42b58-95da-4f65-a38b-2cadeff2c388 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:58.738021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 453/887] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:36:58 2022] GET /identity/v3/endpoints?service_id=a3abc219f1094f23a3ba182d96868361&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:36:58.743183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:58.775711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:58.848708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e954a8-8a12-459b-9f08-15a2edae0624 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:58.884045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b62c-b48d-4726-8e74-28b3bdc82685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:58.884695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b62c-b48d-4726-8e74-28b3bdc82685 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.885046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b62c-b48d-4726-8e74-28b3bdc82685 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.885322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b62c-b48d-4726-8e74-28b3bdc82685 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.886078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b62c-b48d-4726-8e74-28b3bdc82685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:58.887518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b62c-b48d-4726-8e74-28b3bdc82685 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:58.895031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 435/888] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:36:58 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:36:59.794006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605156-3056-43e5-8d1b-8a5e6299835d None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:59.794654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605156-3056-43e5-8d1b-8a5e6299835d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:59.794654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605156-3056-43e5-8d1b-8a5e6299835d None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:59.796197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 454/889] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:36:59.801693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32388f-1023-4dc6-bf7f-1510ee1c8d14 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:59.801995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32388f-1023-4dc6-bf7f-1510ee1c8d14 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:59.802284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32388f-1023-4dc6-bf7f-1510ee1c8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:59.821449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-fc32388f-1023-4dc6-bf7f-1510ee1c8d14 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:59.822672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fc32388f-1023-4dc6-bf7f-1510ee1c8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:59.899389 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 436/890] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:36:59.922397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10605156-3056-43e5-8d1b-8a5e6299835d None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:59.978045 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:00.006973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffd47-f932-488e-ba6f-89255816c771 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.007327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffd47-f932-488e-ba6f-89255816c771 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.007545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffd47-f932-488e-ba6f-89255816c771 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.009023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 437/891] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:00.014330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d51ca-8ce5-4473-8366-b2c48f046bb2 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.014619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d51ca-8ce5-4473-8366-b2c48f046bb2 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.014960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d51ca-8ce5-4473-8366-b2c48f046bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.030441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10605156-3056-43e5-8d1b-8a5e6299835d None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:00.038544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-063d51ca-8ce5-4473-8366-b2c48f046bb2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:00.040177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-063d51ca-8ce5-4473-8366-b2c48f046bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:00.068318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:00.077671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:00.080815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.080815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.080815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.093199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:00.101120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:00.103079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:00.104273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 455/892] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 1 15:36:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:00.113539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:00.128540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 438/893] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:00.150546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d51ca-8ce5-4473-8366-b2c48f046bb2 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:00.229674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2ba94-5f63-4bb3-b644-c8ad6ae25f55 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:00.246165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:00.261215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d51ca-8ce5-4473-8366-b2c48f046bb2 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:00.278054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:00.278781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.279144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.279503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.280816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:00.281420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:00.284401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:00.297594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 456/894] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 1 15:37:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:00.299965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:00.316403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:00.317032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.317355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.317673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.318431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:00.319973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:00.410951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f50a-8d5a-4f07-9ebb-6c0e8361dcc8 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:00.438804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 439/895] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:37:00 2022] POST /identity/v3/services => generated 241 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:00.463610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82268e9-5cf5-4db0-8237-de7127957d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:00.464600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82268e9-5cf5-4db0-8237-de7127957d08 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.465000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82268e9-5cf5-4db0-8237-de7127957d08 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.465288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82268e9-5cf5-4db0-8237-de7127957d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.478753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82268e9-5cf5-4db0-8237-de7127957d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:00.480468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82268e9-5cf5-4db0-8237-de7127957d08 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-d82268e9-5cf5-4db0-8237-de7127957d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:00.498344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:00.499320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:00.500217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:00.500217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:00.500217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:00.500217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:00.500217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 457/896] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:00.506526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:00.527305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:00.627185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5f816-b468-4a52-a315-000699969c2f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:00.663310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:00.663998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.664285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.664563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.665252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:00.665581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:00.666984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:00.679974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 440/897] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:00.682043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9c27-4d7a-4d13-8848-e9662df87c99 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.682687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9c27-4d7a-4d13-8848-e9662df87c99 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.683179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9c27-4d7a-4d13-8848-e9662df87c99 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.684962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 458/898] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:00.686911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:00.690011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052304df-a580-4a14-8a8e-c2e9003d03d0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.690545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052304df-a580-4a14-8a8e-c2e9003d03d0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.691027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052304df-a580-4a14-8a8e-c2e9003d03d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.711700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-052304df-a580-4a14-8a8e-c2e9003d03d0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:00.713281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-052304df-a580-4a14-8a8e-c2e9003d03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:00.732148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:00.765980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:00.788893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 459/899] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:00.796705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff50fd-729a-430f-bed3-1a5ffc96d07f None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:00.811737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052304df-a580-4a14-8a8e-c2e9003d03d0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:00.833885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:00.834537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.834818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.835092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.849018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:00.851644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:37:00.870881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:00.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:37:00.873563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:00.881844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 441/900] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:37:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:00.884546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:00.931732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052304df-a580-4a14-8a8e-c2e9003d03d0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:00.972541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:00.973200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:00.973487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:00.973791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:00.974473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:00.975916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:00.987554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:00.988880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:37:00.990013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:00.993530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 460/901] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Aug 1 15:37:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:00.994775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.023092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.037447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a23269-41e9-4a31-854f-11f78bb33698 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.073328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f7253-745f-481a-81ef-be2f094c2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.076529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f7253-745f-481a-81ef-be2f094c2a5f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.076529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f7253-745f-481a-81ef-be2f094c2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.076529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f7253-745f-481a-81ef-be2f094c2a5f None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.076529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f7253-745f-481a-81ef-be2f094c2a5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:01.076529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f7253-745f-481a-81ef-be2f094c2a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.077132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f7253-745f-481a-81ef-be2f094c2a5f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.078945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.096059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 442/902] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 1 15:37:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:01.099138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e8e6a-8de0-4a5c-9c2e-a22460cb49d7 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.100125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e8e6a-8de0-4a5c-9c2e-a22460cb49d7 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.100938 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e8e6a-8de0-4a5c-9c2e-a22460cb49d7 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.102659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 443/903] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:01.105127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e8e6a-8de0-4a5c-9c2e-a22460cb49d7 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.120679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed4c64-fe39-4032-8b38-37d5897a6618 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.155742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaf076-af33-4c60-aa72-841349cac481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.156285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf076-af33-4c60-aa72-841349cac481 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.156563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf076-af33-4c60-aa72-841349cac481 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.156895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf076-af33-4c60-aa72-841349cac481 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.157597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaf076-af33-4c60-aa72-841349cac481 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:01.157904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaf076-af33-4c60-aa72-841349cac481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.159305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaf076-af33-4c60-aa72-841349cac481 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.164020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 461/904] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:01.165155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339ea4-122b-4a04-ba35-7feadb14536b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.165442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339ea4-122b-4a04-ba35-7feadb14536b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.165744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339ea4-122b-4a04-ba35-7feadb14536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.186517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-eb339ea4-122b-4a04-ba35-7feadb14536b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:01.188126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-eb339ea4-122b-4a04-ba35-7feadb14536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:01.225009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e8e6a-8de0-4a5c-9c2e-a22460cb49d7 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.262873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 462/905] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:01.262873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb339ea4-122b-4a04-ba35-7feadb14536b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.279841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.282176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.282924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.283346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.283740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.352301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.362274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.366605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.379343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb339ea4-122b-4a04-ba35-7feadb14536b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.417299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.417882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.418169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.418447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.419126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:01.419491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.420873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.426552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 463/906] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:01.427345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.472668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 444/907] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:01.473942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.511910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.535689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b08212-1478-4c8f-9082-4f98503a543f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.577446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.578219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.578504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.578801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.579417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.579527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.580834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.589142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07ed8-71e1-4ee5-864d-b66702b6e7a1 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:01.590175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:01.591306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:01.597938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 464/908] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:01.598911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.634244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.635154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.635591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.636009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.636910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] RBAC: Adding query filter params (interface=public, service_id=ea3d6d608c0d4deb8c42c6363affee99, region_id=RegionOne) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:01.637374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.638922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.644350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 445/909] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/endpoints?service_id=ea3d6d608c0d4deb8c42c6363affee99&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:01.645137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.709291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884852f-0521-411d-964d-2c63ca85644a None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.745530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.746168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.746479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.746720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.749045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5829-bc86-4423-8ce1-b4fe396b9670 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.754347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.759534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.761361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:01.775733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:01.776800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:01.777722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:01.777722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:01.777722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:01.777722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:01.777722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 465/910] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:01.777722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.789076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.789785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.790072 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.790349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.791022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:01.791327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.792682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.797608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 446/911] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:01.798379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.823020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.897341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5e6b7-19d9-4f6f-8fd0-d736b481c771 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.906921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3197e4-05a5-4ba1-b901-fb7d89bc7b23 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.936614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.937236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.937526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.937830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.938485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.940408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.944168 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:01.944788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.945093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.945370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.946102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:01.946545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 466/912] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:01.946647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:01.947813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:01.955030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.970173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 447/913] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:01.976055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:02.038098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.089284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.089836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971ee46-cd92-43bb-9f03-7f61757e5aa7 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.117330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecdb8e-928e-440f-878f-b6da5ffd34ec None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.134361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.135002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.135261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.135534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.136213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:02.136537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.138934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.150825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 467/914] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:02.152217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:02.167380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.168139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.168430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.168710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.176747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.178397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:37:02.191326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:02.192252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:02.193138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 448/915] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:02.199217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:02.283768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e12d2-72a6-44c0-8302-91f7b2a77831 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.309893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.318229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f876da8-92fe-4afb-84bf-a839ce882ffa None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.332050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af68e8-4b47-4bd3-b130-3908ee37db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.333299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af68e8-4b47-4bd3-b130-3908ee37db06 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.334292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af68e8-4b47-4bd3-b130-3908ee37db06 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.334891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af68e8-4b47-4bd3-b130-3908ee37db06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.335890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af68e8-4b47-4bd3-b130-3908ee37db06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.338153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af68e8-4b47-4bd3-b130-3908ee37db06 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.356233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.356944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.357292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.357661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.358493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:02.361716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.361716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.371163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.374858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 449/916] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:02.381121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:02.431649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 468/917] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:02.487327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e39ad-b216-4799-a363-16e954713f2d None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.487668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e39ad-b216-4799-a363-16e954713f2d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.487896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e39ad-b216-4799-a363-16e954713f2d None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.489637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 469/918] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:02.492614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32de2b-7fe2-41ee-b42b-5ac9c0213f43 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.495254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1201-da5c-46b9-b766-3910fdc849bd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.495556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1201-da5c-46b9-b766-3910fdc849bd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.495839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1201-da5c-46b9-b766-3910fdc849bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.515576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c6fa1201-da5c-46b9-b766-3910fdc849bd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:02.516906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c6fa1201-da5c-46b9-b766-3910fdc849bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:02.539784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.540345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.540621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.540901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.541726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] RBAC: Adding query filter params (role.id=75132a9b62df4ff3a0f1289c31c4b68b, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=192c96d090b948d38f6becdb8ce42c83) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:02.542034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.543492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.557696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 450/919] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:02 2022] GET /identity/v3/role_assignments?user.id=192c96d090b948d38f6becdb8ce42c83&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=75132a9b62df4ff3a0f1289c31c4b68b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:02.599924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 470/920] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:02.623758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:02.695140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.740165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c657ff-9da9-4c26-865a-fade489c2e7d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.776436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.777226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.777610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.777956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.778704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.780163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:02.790600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:02.791829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:02.792855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:02.794014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 451/921] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:02.800246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa1201-da5c-46b9-b766-3910fdc849bd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:02.903713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa1201-da5c-46b9-b766-3910fdc849bd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.906895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.941733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.942710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.943172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.943634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.944505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:02.945041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.946842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.956923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 471/922] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:02.958501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:03.061666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa82cf9-ff28-443f-a828-7363deb6ad93 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:03.086536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:03.097369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:03.098023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:03.098309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:03.100046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:03.100046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:03.100046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:03.101087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:03.111386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 452/923] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:03.112930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:03.223201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b75b0-2d4c-4fdf-b9a4-2ffc0b02e295 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:03.258527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344d39e-b21f-4e99-a5b1-cf217709d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:03.259152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344d39e-b21f-4e99-a5b1-cf217709d07e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:03.259444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344d39e-b21f-4e99-a5b1-cf217709d07e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:03.259722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344d39e-b21f-4e99-a5b1-cf217709d07e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:03.260485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344d39e-b21f-4e99-a5b1-cf217709d07e None admin] RBAC: Adding query filter params (interface=public, service_id=944e2bc4635c456bad4c8945edf62355, region_id=RegionOne) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:03.260796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344d39e-b21f-4e99-a5b1-cf217709d07e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:03.262205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344d39e-b21f-4e99-a5b1-cf217709d07e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:03.267909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 472/924] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:37:03 2022] GET /identity/v3/endpoints?service_id=944e2bc4635c456bad4c8945edf62355&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:03.273292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:03.386387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404fd99-36b2-4a1b-b7cb-cfd09f4746eb None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:03.420441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbdfe7-6bb0-4cd1-9b41-2f55ce9b3c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:03.421060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbdfe7-6bb0-4cd1-9b41-2f55ce9b3c1b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:03.421345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbdfe7-6bb0-4cd1-9b41-2f55ce9b3c1b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:03.421647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbdfe7-6bb0-4cd1-9b41-2f55ce9b3c1b None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:03.422290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbdfe7-6bb0-4cd1-9b41-2f55ce9b3c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:03.423672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbdfe7-6bb0-4cd1-9b41-2f55ce9b3c1b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:03.429982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 453/925] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:37:03 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:04.140990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d894-e8f5-47ae-abde-783d825f8f5d None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.141573 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d894-e8f5-47ae-abde-783d825f8f5d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.141784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d894-e8f5-47ae-abde-783d825f8f5d None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.143558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 473/926] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:04.149008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7da12-9b49-41d6-bf7e-08f1b6c18b15 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.149459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7da12-9b49-41d6-bf7e-08f1b6c18b15 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.149787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7da12-9b49-41d6-bf7e-08f1b6c18b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.168871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0ea7da12-9b49-41d6-bf7e-08f1b6c18b15 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:04.170098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0ea7da12-9b49-41d6-bf7e-08f1b6c18b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:04.224182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.246259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 454/927] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:04.268517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d894-e8f5-47ae-abde-783d825f8f5d None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:04.301990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.376123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d894-e8f5-47ae-abde-783d825f8f5d None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:04.411631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7c4bc-b7c6-49bf-a9f0-366f4daa3b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:04.412195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7c4bc-b7c6-49bf-a9f0-366f4daa3b73 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.412477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7c4bc-b7c6-49bf-a9f0-366f4daa3b73 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.412752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7c4bc-b7c6-49bf-a9f0-366f4daa3b73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.413374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7c4bc-b7c6-49bf-a9f0-366f4daa3b73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:04.414818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7c4bc-b7c6-49bf-a9f0-366f4daa3b73 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-46b7c4bc-b7c6-49bf-a9f0-366f4daa3b73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:04.424421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:04.425361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.426617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 474/928] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Aug 1 15:37:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:04.432114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7da12-9b49-41d6-bf7e-08f1b6c18b15 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:04.538737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7da12-9b49-41d6-bf7e-08f1b6c18b15 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:04.568382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3846-0a4d-4d4a-a751-f02623f4d7c5 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.568705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3846-0a4d-4d4a-a751-f02623f4d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.568933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3846-0a4d-4d4a-a751-f02623f4d7c5 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.571042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 475/929] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:04.576177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b0e2-ff43-4892-a604-291237c525c9 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.576476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b0e2-ff43-4892-a604-291237c525c9 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.576753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b0e2-ff43-4892-a604-291237c525c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.579900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:04.579900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.579900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.579900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.580344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:04.580652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:04.582234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:04.593625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 455/930] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:04.594525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:04.601925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a3e3b0e2-ff43-4892-a604-291237c525c9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:04.603133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a3e3b0e2-ff43-4892-a604-291237c525c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:04.654648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.697864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 476/931] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:04.721726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3b0e2-ff43-4892-a604-291237c525c9 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:04.727823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479492e-cec8-4938-9a77-4e53c1e1c0da None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:04.749972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.768713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67411-8c14-47ae-a20a-26c1728af498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:04.770630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67411-8c14-47ae-a20a-26c1728af498 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.770630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67411-8c14-47ae-a20a-26c1728af498 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.770630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67411-8c14-47ae-a20a-26c1728af498 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.770630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67411-8c14-47ae-a20a-26c1728af498 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:04.770931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67411-8c14-47ae-a20a-26c1728af498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:04.772227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67411-8c14-47ae-a20a-26c1728af498 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:04.781543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 456/932] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:04.781543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee5f0-5944-4860-b3df-e89ccd5769bc None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.781543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee5f0-5944-4860-b3df-e89ccd5769bc None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.781543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee5f0-5944-4860-b3df-e89ccd5769bc None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.781543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 457/933] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:04.785946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee5f0-5944-4860-b3df-e89ccd5769bc None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:04.829184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3b0e2-ff43-4892-a604-291237c525c9 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:04.864514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:04.865172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.865453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.865756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.866445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:04.867878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:04.870504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING keystone.server.flask.common [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 15:37:04.890195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee5f0-5944-4860-b3df-e89ccd5769bc None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:04.901014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.915057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.sql.core [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:37:04.915057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 15:37:04.915057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [parameters: {'id': '086658374fe14a08ab88dc4e63d3bf70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 15:37:04.915057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92565) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-63769bbe-736a-4ea0-8b31-4720d360004c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 086658374fe14a08ab88dc4e63d3bf70.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 086658374fe14a08ab88dc4e63d3bf70. Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:37:04.922644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result.read() Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 15:37:04.925876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application yield resource Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise self.value Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application session.commit() Aug 01 15:37:04.926819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:37:04.927696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:37:04.928571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application result.read() Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:37:04.929783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [parameters: {'id': '086658374fe14a08ab88dc4e63d3bf70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:04.931873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:04.933567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 086658374fe14a08ab88dc4e63d3bf70. Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 477/934] 10.222.0.77 () {60 vars in 1140 bytes} [Mon Aug 1 15:37:04 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7c36-3c6a-492f-be17-bafc24b7c0e5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.935424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7c36-3c6a-492f-be17-bafc24b7c0e5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.936773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7c36-3c6a-492f-be17-bafc24b7c0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.936908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:04.936908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.936908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.936908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.937398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:04.937398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:04.951742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-641a7c36-3c6a-492f-be17-bafc24b7c0e5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:04.953287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-641a7c36-3c6a-492f-be17-bafc24b7c0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:05.019893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 478/935] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:05.020728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a7c36-3c6a-492f-be17-bafc24b7c0e5 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.034850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:05.047590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 458/936] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:05.052863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.174377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a7c36-3c6a-492f-be17-bafc24b7c0e5 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:05.195642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416d70-0081-40c1-894a-6bebaa6786ff None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:05.230578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:05.230781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.231360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.231360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.240185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:05.241899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:05.244103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:05.245073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.245565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.246013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:37:05.253695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:05.254583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:05.255913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 479/937] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:05.260572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.261639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:05.268183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:05.269296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:05.270294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:05.272278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 459/938] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:05.278607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.309478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:05.340232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:05.372032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ccad-5a2f-48dd-a3a4-d59cf38cce05 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:05.389796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701969f-c7a3-4862-b4e8-cb17a3b85f31 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:05.409010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:05.409872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.409995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.410205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.410936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:05.411253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:05.412687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:05.428587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ce07-78f4-45d1-bc50-77c540d19633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:05.429458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ce07-78f4-45d1-bc50-77c540d19633 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.429930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ce07-78f4-45d1-bc50-77c540d19633 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.430347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ce07-78f4-45d1-bc50-77c540d19633 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.431583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ce07-78f4-45d1-bc50-77c540d19633 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:05.432031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ce07-78f4-45d1-bc50-77c540d19633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:05.433649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ce07-78f4-45d1-bc50-77c540d19633 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:05.434326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 480/939] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:05.451312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 460/940] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:05.454713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.570981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1bcc-a999-4400-ba95-1f5bfac356ca None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.571337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1bcc-a999-4400-ba95-1f5bfac356ca None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.571439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5104fc-31dc-48bd-b0ef-119eb259171d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:05.571541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1bcc-a999-4400-ba95-1f5bfac356ca None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.573191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 461/941] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:05.578921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355dec-afc7-4f5e-92c9-8ee6244c116b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.579244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355dec-afc7-4f5e-92c9-8ee6244c116b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.579487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355dec-afc7-4f5e-92c9-8ee6244c116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.601922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-9a355dec-afc7-4f5e-92c9-8ee6244c116b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:05.603574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9a355dec-afc7-4f5e-92c9-8ee6244c116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:05.604260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:05.613277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:05.613960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.614243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.614518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.627978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:05.629827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:05.646560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:05.647512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:05.649863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:05.649863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:05.649863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:05.649863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:05.649863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 481/942] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:05.653613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.690958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 462/943] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:05.713978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a355dec-afc7-4f5e-92c9-8ee6244c116b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.734617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:05.763310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b43db2-b92b-483f-9a0c-94678899705c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:05.806689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:05.807064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.807345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.807620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.808333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:05.808656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:05.810191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:05.823479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 482/944] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:05.829181 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.865344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a355dec-afc7-4f5e-92c9-8ee6244c116b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:05.880045 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:05.908090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:05.908686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:05.908966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:05.909281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:05.909942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:05.911323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:05.920707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:05.921728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:05.922575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:05.925794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 463/945] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:05.928737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:05.955870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbd72-ff0c-4853-be96-de12b17d161b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.007507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.008883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.009918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.010196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.019383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:06.024422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.026727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.041230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2aa60-db26-4fb1-a808-0b752975f863 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:37:06.042857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:06.043767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:37:06.044784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:06.047867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 483/946] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:06.054305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:06.083421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.084079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.084428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.084781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.085555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:06.085921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.087469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.097764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 464/947] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:06.099572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:06.193167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67561279-d171-45e8-a1d2-83a187f6def9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.197846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:06.221876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7956fc-1b8f-46c0-9122-26c5e49df3a4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.235406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.236688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.237128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.237363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.238277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:06.238648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.240386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.260687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 484/948] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 1 15:37:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:06.262554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.263195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.263478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.263752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.264438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:06.264755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.266050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:06.266342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.272742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 465/949] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:06.278289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:06.297452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:06.380094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247414-9b3c-4da1-8446-14a81ff52aa6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.415569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64306a89-fdb1-49ec-a952-5d63343c5649 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.416215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.417340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.418742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.419252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.433144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.435458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.455615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.456244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.456530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.456806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:06.457270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:06.458148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:06.459041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:06.459041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:06.459041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:06.459041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:06.459257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.459257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.461384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 485/950] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:06.466674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:06.486874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:06.552390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 466/951] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:06.590654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0b8f-cf4a-467c-937f-1e8dc54858d4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.637584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.638154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.638439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.638716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.639425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:06.639731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.641137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.656843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 486/952] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:06.663525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:06.733878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:06.773960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731c735-c853-4c2b-a5d2-4d9691d2b613 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.810342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.811001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.811288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.811561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.819632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:06.821000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:37:06.834003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:06.834983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:06.836322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 467/953] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:06.841405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:06.922599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:06.954138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ea94b-95ad-4bbf-8aee-3e32ed57ad78 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:06.995026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa630a-70e3-4c61-b9b4-c3e77a981cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:06.996014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa630a-70e3-4c61-b9b4-c3e77a981cbb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:06.996505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa630a-70e3-4c61-b9b4-c3e77a981cbb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:06.996986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa630a-70e3-4c61-b9b4-c3e77a981cbb None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:06.998056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa630a-70e3-4c61-b9b4-c3e77a981cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:06.998575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa630a-70e3-4c61-b9b4-c3e77a981cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:07.000383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa630a-70e3-4c61-b9b4-c3e77a981cbb None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:07.013939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 487/954] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:07.022760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:07.131095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be4ae-4786-4afd-bc59-c40a452e107d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:07.155953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:07.168890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:07.170017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.170576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.171077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/192c96d090b948d38f6becdb8ce42c83/roles/75132a9b62df4ff3a0f1289c31c4b68b` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.173814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=192c96d090b948d38f6becdb8ce42c83, role_id=75132a9b62df4ff3a0f1289c31c4b68b)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:07.175581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:07.225163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338803e9-1600-4c10-8109-5e021fc43bf5 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.225706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338803e9-1600-4c10-8109-5e021fc43bf5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.225784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338803e9-1600-4c10-8109-5e021fc43bf5 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.227224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 488/955] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:07.232537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4663a9-7bbb-4bc5-8f37-a482d7e55c73 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.232899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4663a9-7bbb-4bc5-8f37-a482d7e55c73 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.233271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4663a9-7bbb-4bc5-8f37-a482d7e55c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.253128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4f4663a9-7bbb-4bc5-8f37-a482d7e55c73 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:07.254497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4f4663a9-7bbb-4bc5-8f37-a482d7e55c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:07.307032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 468/956] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:37:07 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/192c96d090b948d38f6becdb8ce42c83/roles/75132a9b62df4ff3a0f1289c31c4b68b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:07.339230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 489/957] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:07.362852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:07.481340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41046-c0ab-439d-925d-63203f623829 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:07.520243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9034fa9-e47d-4b1b-80ec-dd401f3b4d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:07.520892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034fa9-e47d-4b1b-80ec-dd401f3b4d84 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.521177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034fa9-e47d-4b1b-80ec-dd401f3b4d84 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.521463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034fa9-e47d-4b1b-80ec-dd401f3b4d84 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.522127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9034fa9-e47d-4b1b-80ec-dd401f3b4d84 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:07.523563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9034fa9-e47d-4b1b-80ec-dd401f3b4d84 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-f9034fa9-e47d-4b1b-80ec-dd401f3b4d84 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:07.532940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:07.534138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.535600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 469/958] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:07.540600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4663a9-7bbb-4bc5-8f37-a482d7e55c73 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:07.581733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ff4d-b1ad-4340-91f4-f6244ea10fb5 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.582025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ff4d-b1ad-4340-91f4-f6244ea10fb5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.582598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ff4d-b1ad-4340-91f4-f6244ea10fb5 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.584046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 470/959] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:07.589086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93138dc-1ff3-454b-9053-66d80090887b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.589375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93138dc-1ff3-454b-9053-66d80090887b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.589700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93138dc-1ff3-454b-9053-66d80090887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.604299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:07.612728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b93138dc-1ff3-454b-9053-66d80090887b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:07.614037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b93138dc-1ff3-454b-9053-66d80090887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:07.652033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4663a9-7bbb-4bc5-8f37-a482d7e55c73 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:07.672556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:07.692423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:07.693049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.693333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.693654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.694344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:07.694650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:07.696043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:07.701241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 490/960] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:37:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:07.707230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:07.708412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 471/961] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:07.736274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93138dc-1ff3-454b-9053-66d80090887b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:07.824861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb90d1-acaf-4309-8cd5-a95a742df153 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:07.853004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:07.867684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:07.868530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.869034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.869203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93138dc-1ff3-454b-9053-66d80090887b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:07.869666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.870498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:07.871141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:07.875504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:07.890317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 491/962] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:37:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:07.919281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:07.919932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.920218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.920498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.921192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:07.922723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:07.925506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING keystone.server.flask.common [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 15:37:07.972338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.sql.core [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:37:07.972338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 15:37:07.972338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [parameters: {'user_id': '8ba46ec4388e4c77b39d7e257c6d92a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 15:37:07.972338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92564) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application result.read() Aug 01 15:37:07.990678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:37:07.991811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application yield resource Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise self.value Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application session.commit() Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:37:07.993025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:37:07.994412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:37:07.995497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application result.read() Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:37:07.996366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [parameters: {'user_id': '8ba46ec4388e4c77b39d7e257c6d92a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:07.997218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 15:37:07.998061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 15:37:07.999164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 15:37:07.999164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 15:37:07.999164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:37:07.999164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:37:07.999164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 15:37:07.999164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:07.999164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 472/963] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 1 15:37:07 2022] POST /identity/v3/users => generated 160 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:08.002539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:08.111591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db3b65-1d2a-48e6-b9b0-578bb34d1421 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:08.146832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81c2f0-367a-4abd-a19a-b67f1b041dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:08.147740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81c2f0-367a-4abd-a19a-b67f1b041dae None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:08.148193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81c2f0-367a-4abd-a19a-b67f1b041dae None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:08.148626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81c2f0-367a-4abd-a19a-b67f1b041dae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:08.156033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81c2f0-367a-4abd-a19a-b67f1b041dae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:08.157716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81c2f0-367a-4abd-a19a-b67f1b041dae None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-ba81c2f0-367a-4abd-a19a-b67f1b041dae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:37:08.169671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:08.170847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:37:08.172092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:08.174835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 492/964] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:37:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:08.181487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:08.224594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:08.296520 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c7cfa-2feb-4b6f-bfbc-1a44144bb811 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:08.332932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba95f5-547b-4a80-a0e5-4fc57692e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:08.333579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba95f5-547b-4a80-a0e5-4fc57692e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:08.333856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba95f5-547b-4a80-a0e5-4fc57692e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:08.334134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba95f5-547b-4a80-a0e5-4fc57692e2e5 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:08.334889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba95f5-547b-4a80-a0e5-4fc57692e2e5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:08.335194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba95f5-547b-4a80-a0e5-4fc57692e2e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:08.336840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba95f5-547b-4a80-a0e5-4fc57692e2e5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:08.376995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 473/965] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 1 15:37:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:08.822602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6babbd-a3a2-4d16-957e-62ca49e5fffe None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:08.823173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6babbd-a3a2-4d16-957e-62ca49e5fffe None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:08.823173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6babbd-a3a2-4d16-957e-62ca49e5fffe None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:08.824654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 493/966] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:08.829913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a356ef-5f86-4d47-8343-8c5773a82a22 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:08.830211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a356ef-5f86-4d47-8343-8c5773a82a22 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:08.830494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a356ef-5f86-4d47-8343-8c5773a82a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:08.848542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-18a356ef-5f86-4d47-8343-8c5773a82a22 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:08.850082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-18a356ef-5f86-4d47-8343-8c5773a82a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:08.922584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 474/967] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:08.945971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6babbd-a3a2-4d16-957e-62ca49e5fffe None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:08.996792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.051454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6babbd-a3a2-4d16-957e-62ca49e5fffe None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.088495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:09.089059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.089345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.089656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.090388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:09.091733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:09.101420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:09.102569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:09.103412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:09.107639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 494/968] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:09.108936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a356ef-5f86-4d47-8343-8c5773a82a22 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:09.137018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.209991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a356ef-5f86-4d47-8343-8c5773a82a22 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.244619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212198c-b980-4e83-a20a-fcccb8e19fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:09.245248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212198c-b980-4e83-a20a-fcccb8e19fde None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.245549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212198c-b980-4e83-a20a-fcccb8e19fde None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.245839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212198c-b980-4e83-a20a-fcccb8e19fde None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.246524 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212198c-b980-4e83-a20a-fcccb8e19fde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:09.246837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212198c-b980-4e83-a20a-fcccb8e19fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:09.248222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212198c-b980-4e83-a20a-fcccb8e19fde None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:09.257845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 475/969] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:09.259387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:09.369736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90c0f3-3a43-499d-9a3f-b84f1e27d2c4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.383859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.390648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9120ee2-07fd-433a-9fe5-d8622e53b2d8 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.391144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9120ee2-07fd-433a-9fe5-d8622e53b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.391348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9120ee2-07fd-433a-9fe5-d8622e53b2d8 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.392797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 476/970] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:09.397562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7275-52c2-4a9a-b479-d768bdb6adf5 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.397858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7275-52c2-4a9a-b479-d768bdb6adf5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.399916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7275-52c2-4a9a-b479-d768bdb6adf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.407461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:09.408612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.408891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.409157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.409858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:09.410160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:09.411602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:09.421733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 495/971] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:09.421910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-421d7275-52c2-4a9a-b479-d768bdb6adf5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:09.421910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-421d7275-52c2-4a9a-b479-d768bdb6adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:09.423967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:09.492265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 477/972] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:09.515051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7275-52c2-4a9a-b479-d768bdb6adf5 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:09.535759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3eec5-1603-43e9-b50a-74d3b6c0ab04 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.536612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.571444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:09.572300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.572776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.573056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.573852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] RBAC: Adding query filter params (interface=admin, service_id=944e2bc4635c456bad4c8945edf62355, region_id=RegionOne) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:09.574157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:09.575663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:09.580928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 496/973] 10.222.0.77 () {56 vars in 1249 bytes} [Mon Aug 1 15:37:09 2022] GET /identity/v3/endpoints?service_id=944e2bc4635c456bad4c8945edf62355&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:09.586329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:09.626099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7275-52c2-4a9a-b479-d768bdb6adf5 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.629798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.662564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:09.663219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.663504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.663782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.675512 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:09.680862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:09.681834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:09.682667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 478/974] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 1 15:37:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:09.688599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:09.695477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e9279-2888-4cee-8be1-3e31ebc9e6e2 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.733255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:09.733966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.734180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.734452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.735197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:09.736987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:09.743474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 497/975] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:37:09 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:09.781267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.802945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a118693-c124-4f44-995b-9b8b46581e7b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.842964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb7853-857e-400c-862e-c03d84c3ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:09.843618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7853-857e-400c-862e-c03d84c3ad94 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.843898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7853-857e-400c-862e-c03d84c3ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.844174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7853-857e-400c-862e-c03d84c3ad94 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.844895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7853-857e-400c-862e-c03d84c3ad94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:09.845897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7853-857e-400c-862e-c03d84c3ad94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:09.847314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7853-857e-400c-862e-c03d84c3ad94 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:09.861395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 479/976] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 1 15:37:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:09.863352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:09.977337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f40b0-b898-4f85-82d9-63b8f41d5b1b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:09.977961 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3665f28-b055-4c39-b1f2-0f0ccd51811b None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.978257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3665f28-b055-4c39-b1f2-0f0ccd51811b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.978537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3665f28-b055-4c39-b1f2-0f0ccd51811b None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:09.979893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 480/977] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:09.981853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.985012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78305-4538-4213-bc54-f9e5d38ff693 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:09.985405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78305-4538-4213-bc54-f9e5d38ff693 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:09.985814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78305-4538-4213-bc54-f9e5d38ff693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.004820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a7d78305-4538-4213-bc54-f9e5d38ff693 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:10.008744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a7d78305-4538-4213-bc54-f9e5d38ff693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:10.016633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:10.017992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.018344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.018689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.029952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:10.031495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:10.046174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:10.047372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:10.048506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:10.048506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:10.048506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:10.048506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:10.053772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 498/978] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:10.054707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:10.091181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 481/979] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:10.113607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d78305-4538-4213-bc54-f9e5d38ff693 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:10.156902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f084-d662-4769-9574-229eb2e1aae6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:10.192039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:10.194007 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:10.194764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.195124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.195472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.196238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:10.196618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:10.198216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:10.213239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 499/980] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:10.217951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:10.225481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d78305-4538-4213-bc54-f9e5d38ff693 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:10.240515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:10.262621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:10.263417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.263802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.264191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.264980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:10.266409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:10.326559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1e824-18be-4295-9a0b-bd15e002c354 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:10.359553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:10.360189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.360472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.361297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.368423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:10.369899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:10.370575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 482/981] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:37:10 2022] POST /identity/v3/services => generated 242 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:37:10.387487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:10.388563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:10.395064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 500/982] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:37:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:10.395834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:10.518330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9bf3c-bb5c-4acb-9691-f8f320d87a6d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:10.546497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:10.555925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:10.556645 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.557062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.557458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.561569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:10.561569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:10.561569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:10.578641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 483/983] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 1 15:37:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:10.584537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:10.665402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:10.688624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c74cf-f2a8-433e-bf28-8b90e758d152 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:10.722594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:10.723219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.723501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.723779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.791486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:10.792860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:10.870445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:10.902637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 501/984] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:10 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:10.903853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:11.006224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5abcd-6856-423d-8619-7b908e37f60e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:11.041935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:11.042504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:11.042787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:11.043064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:11.053191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:11.054666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:11.069466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:11.070487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:11.071830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:11.071830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:11.071830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:11.071830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:11.071830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 484/985] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:11.076218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:11.176170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6be48-3230-4458-ba9f-0eaa32b049d3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:11.209578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:11.210197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:11.210480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:11.210763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:11.211448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:11.211753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:11.213121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:11.229592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 502/986] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:11.230871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:11.272325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:11.340300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595c55a-1859-43ae-82cf-d8cb5a5c0672 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:11.375125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:11.375818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:11.376111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:11.376970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:11.384178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:11.385656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:37:11.398009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:11.399330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:11.400218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:11.401666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 485/987] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:11.405248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:11.443883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:11.511506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56676a8b-5e3e-40e3-a338-5d94adcf9de6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:11.545467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaef6b2-5285-459f-9cfe-cb51f653fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:11.546113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaef6b2-5285-459f-9cfe-cb51f653fd93 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:11.546394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaef6b2-5285-459f-9cfe-cb51f653fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:11.546669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaef6b2-5285-459f-9cfe-cb51f653fd93 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:11.547414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaef6b2-5285-459f-9cfe-cb51f653fd93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:11.547719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaef6b2-5285-459f-9cfe-cb51f653fd93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:11.549176 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaef6b2-5285-459f-9cfe-cb51f653fd93 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:11.561831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 503/988] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:11.568020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:11.664251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:11.668518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d30e-4171-4fd4-8c9d-8fd57d6432ff None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:11.707193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cf19f-78f1-46ec-a553-f4a8e1c1af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:11.707809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cf19f-78f1-46ec-a553-f4a8e1c1af5d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:11.708090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cf19f-78f1-46ec-a553-f4a8e1c1af5d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:11.708360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cf19f-78f1-46ec-a553-f4a8e1c1af5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:11.709140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cf19f-78f1-46ec-a553-f4a8e1c1af5d None admin] RBAC: Adding query filter params (role.id=75132a9b62df4ff3a0f1289c31c4b68b, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=192c96d090b948d38f6becdb8ce42c83) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:11.709445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cf19f-78f1-46ec-a553-f4a8e1c1af5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:11.710898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cf19f-78f1-46ec-a553-f4a8e1c1af5d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:11.722566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 486/989] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:11 2022] GET /identity/v3/role_assignments?user.id=192c96d090b948d38f6becdb8ce42c83&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=75132a9b62df4ff3a0f1289c31c4b68b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:11.794687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f705-c994-4a38-beb2-68be8c9e6274 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:11.794993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f705-c994-4a38-beb2-68be8c9e6274 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:11.795254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f705-c994-4a38-beb2-68be8c9e6274 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:11.796844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 504/990] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:11.803083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde882-a53a-408d-aa97-21370db5a4cb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:11.803376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde882-a53a-408d-aa97-21370db5a4cb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:11.803659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde882-a53a-408d-aa97-21370db5a4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:11.823299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-69cde882-a53a-408d-aa97-21370db5a4cb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:11.824433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-69cde882-a53a-408d-aa97-21370db5a4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:11.901923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 487/991] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:11.924950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390f705-c994-4a38-beb2-68be8c9e6274 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:12.022622 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:12.030217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390f705-c994-4a38-beb2-68be8c9e6274 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:12.065825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:12.066473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.066755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.067033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.067998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:12.069539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:12.079048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:12.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:37:12.081047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:12.085443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 505/992] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 1 15:37:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:12.086976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cde882-a53a-408d-aa97-21370db5a4cb None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:12.180604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:12.190806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cde882-a53a-408d-aa97-21370db5a4cb None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:12.226135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:12.226755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.227039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.229011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.229011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:12.229011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:12.229803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:12.234977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 488/993] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:12.241423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:12.354646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1346e2-58e3-4ad9-8650-e1c50720fef0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:12.389848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6484-1008-4e85-957e-8b71c75ef0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:12.390467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6484-1008-4e85-957e-8b71c75ef0a9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.390746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6484-1008-4e85-957e-8b71c75ef0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.391018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6484-1008-4e85-957e-8b71c75ef0a9 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.391697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6484-1008-4e85-957e-8b71c75ef0a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:12.392552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6484-1008-4e85-957e-8b71c75ef0a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:12.393945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6484-1008-4e85-957e-8b71c75ef0a9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:12.403601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 506/994] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 1 15:37:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:12.405178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:12.427022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6075507-a325-4c5c-9e8a-39d11e930771 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.427324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6075507-a325-4c5c-9e8a-39d11e930771 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.427601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6075507-a325-4c5c-9e8a-39d11e930771 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.429418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 507/995] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:12.434626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb06132-b175-4584-a3f5-03b4e6c37929 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.434920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb06132-b175-4584-a3f5-03b4e6c37929 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.435208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb06132-b175-4584-a3f5-03b4e6c37929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.453498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3fb06132-b175-4584-a3f5-03b4e6c37929 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:12.455286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3fb06132-b175-4584-a3f5-03b4e6c37929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:12.475302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:12.518289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325fb43-9ea6-4e38-a8fd-81d8129cff7b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:12.533665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 508/996] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:12.551799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb06132-b175-4584-a3f5-03b4e6c37929 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:12.553701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:12.554369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.554653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.554924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.555917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:12.557472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:12.627358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 489/997] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:12.667387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb06132-b175-4584-a3f5-03b4e6c37929 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:12.713640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:12.714305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.714590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.714866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] PATH_INFO: `/v3/services/compute` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.715696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:12.716912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:12.727325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:12.728405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:12.729298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 509/998] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:12.734592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:12.755073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:12.844468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c525b-8e36-4068-973f-377daeb06603 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:12.880726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:12.881292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:12.881650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:12.881932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:12.882670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:12.882983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:12.884439 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:12.895438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 490/999] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:37:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:12.897058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:12.914828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:13.000558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dc487-eb19-4fef-8c0f-2b9fd109d54f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:13.035393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:13.036012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:13.036294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:13.036570 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:13.037243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:13.037571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:13.038951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:13.048448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 510/1000] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:37:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:13.049791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:13.136255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:13.157168 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db555837-6d06-4319-9de3-01ecb0c39ef1 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:13.191052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fcf46-7762-4c43-8e89-ecdd409fad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:13.191698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fcf46-7762-4c43-8e89-ecdd409fad15 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:13.191981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fcf46-7762-4c43-8e89-ecdd409fad15 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:13.192261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fcf46-7762-4c43-8e89-ecdd409fad15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:13.193030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fcf46-7762-4c43-8e89-ecdd409fad15 None admin] RBAC: Adding query filter params (interface=public, service_id=da516e73cab84ee49ed130de8dd80d48, region_id=RegionOne) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:13.193339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fcf46-7762-4c43-8e89-ecdd409fad15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:13.194736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fcf46-7762-4c43-8e89-ecdd409fad15 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:13.200214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 491/1001] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:37:13 2022] GET /identity/v3/endpoints?service_id=da516e73cab84ee49ed130de8dd80d48&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:13.206073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:13.296373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:13.319472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929f676-a1ea-445c-bdca-2135710af813 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:13.353255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf59b67-3bb4-4acc-b47c-ec98195cc598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:13.354075 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf59b67-3bb4-4acc-b47c-ec98195cc598 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:13.354456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf59b67-3bb4-4acc-b47c-ec98195cc598 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:13.354828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf59b67-3bb4-4acc-b47c-ec98195cc598 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:13.355695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf59b67-3bb4-4acc-b47c-ec98195cc598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:13.357184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf59b67-3bb4-4acc-b47c-ec98195cc598 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:13.369543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 511/1002] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:37:13 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:13.776220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca4c7-68a9-4aab-8e51-1ff59cc599b3 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:13.776763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca4c7-68a9-4aab-8e51-1ff59cc599b3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:13.776763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca4c7-68a9-4aab-8e51-1ff59cc599b3 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:13.778532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 492/1003] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:13.783959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3125884-6295-4aa3-a4b7-059424d63580 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:13.784240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3125884-6295-4aa3-a4b7-059424d63580 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:13.784519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3125884-6295-4aa3-a4b7-059424d63580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:13.802279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c3125884-6295-4aa3-a4b7-059424d63580 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:13.803453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c3125884-6295-4aa3-a4b7-059424d63580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:13.870779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 512/1004] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:13.893044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ca4c7-68a9-4aab-8e51-1ff59cc599b3 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:13.999436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ca4c7-68a9-4aab-8e51-1ff59cc599b3 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:14.033147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:14.033735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:14.034018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:14.034292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] PATH_INFO: `/v3/services/image` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:14.034908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:14.036278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:14.045295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:14.046507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:14.047352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:14.049837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 493/1005] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Aug 1 15:37:13 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:14.053010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3125884-6295-4aa3-a4b7-059424d63580 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:14.123026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:14.152180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3125884-6295-4aa3-a4b7-059424d63580 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:14.186057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3533051-c0bc-4e9d-a835-77dc1f5424fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:14.186673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533051-c0bc-4e9d-a835-77dc1f5424fe None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:14.186951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533051-c0bc-4e9d-a835-77dc1f5424fe None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:14.187222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533051-c0bc-4e9d-a835-77dc1f5424fe None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:14.187979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3533051-c0bc-4e9d-a835-77dc1f5424fe None admin] RBAC: Adding query filter params (name=image) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:14.188198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3533051-c0bc-4e9d-a835-77dc1f5424fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:14.190160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3533051-c0bc-4e9d-a835-77dc1f5424fe None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:14.195096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 513/1006] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:14.200588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:14.211945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:14.308049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242531-c7b6-4659-8705-7b520fbeabcf None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:14.344509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2568d-35c6-411b-9138-ea51fba1175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:14.345675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2568d-35c6-411b-9138-ea51fba1175b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:14.345957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2568d-35c6-411b-9138-ea51fba1175b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:14.346222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2568d-35c6-411b-9138-ea51fba1175b None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:14.346887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2568d-35c6-411b-9138-ea51fba1175b None admin] RBAC: Adding query filter params (type=image) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:14.347187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2568d-35c6-411b-9138-ea51fba1175b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:14.348544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2568d-35c6-411b-9138-ea51fba1175b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:14.361614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 494/1007] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:14.700754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082170f-528d-4755-ad1e-293e870156bb None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:14.700754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082170f-528d-4755-ad1e-293e870156bb None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:14.700754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082170f-528d-4755-ad1e-293e870156bb None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:14.702200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 514/1008] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:14.707997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5705a-6052-42a2-a9a4-a82f1ccc875c None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:14.708378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5705a-6052-42a2-a9a4-a82f1ccc875c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:14.708732 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5705a-6052-42a2-a9a4-a82f1ccc875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:14.726993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-79a5705a-6052-42a2-a9a4-a82f1ccc875c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:14.728167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-79a5705a-6052-42a2-a9a4-a82f1ccc875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:14.797421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 495/1009] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:14.821277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082170f-528d-4755-ad1e-293e870156bb None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:14.930838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082170f-528d-4755-ad1e-293e870156bb None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:14.966885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a9cd5-a78e-43f8-a46a-62a8dc659983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:14.967482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9cd5-a78e-43f8-a46a-62a8dc659983 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:14.967778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9cd5-a78e-43f8-a46a-62a8dc659983 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:14.968053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9cd5-a78e-43f8-a46a-62a8dc659983 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:14.969213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a9cd5-a78e-43f8-a46a-62a8dc659983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:14.971289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a9cd5-a78e-43f8-a46a-62a8dc659983 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:14.972977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 515/1010] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:14.979073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5705a-6052-42a2-a9a4-a82f1ccc875c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:14.981431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:15.081025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5705a-6052-42a2-a9a4-a82f1ccc875c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:15.115407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e87b56-ab7b-4e32-843a-9b4b351ac73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:15.116037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e87b56-ab7b-4e32-843a-9b4b351ac73e None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:15.116323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e87b56-ab7b-4e32-843a-9b4b351ac73e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:15.116599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e87b56-ab7b-4e32-843a-9b4b351ac73e None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:15.117322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e87b56-ab7b-4e32-843a-9b4b351ac73e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:15.118802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e87b56-ab7b-4e32-843a-9b4b351ac73e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:15.239810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 496/1011] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:37:14 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:15.388438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea151d64-88f2-4c4f-83b8-aea7e84fdc6f None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:15.388961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea151d64-88f2-4c4f-83b8-aea7e84fdc6f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:15.388961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea151d64-88f2-4c4f-83b8-aea7e84fdc6f None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:15.390518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 516/1012] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:15.395735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3c5a-6a25-4dab-b2da-65164cd39bde None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:15.396164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3c5a-6a25-4dab-b2da-65164cd39bde None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:15.396539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3c5a-6a25-4dab-b2da-65164cd39bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:15.415665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d20b3c5a-6a25-4dab-b2da-65164cd39bde None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:15.417083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d20b3c5a-6a25-4dab-b2da-65164cd39bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:15.471505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:15.489698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 497/1013] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:15.512922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea151d64-88f2-4c4f-83b8-aea7e84fdc6f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:15.517786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:15.616735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea151d64-88f2-4c4f-83b8-aea7e84fdc6f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:15.651523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:15.652277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:15.652569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:15.652848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] PATH_INFO: `/v3/services/compute` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:15.653527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:15.654906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:15.663891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:15.664928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:37:15.665881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:15.669612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 517/1014] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:15.671312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3c5a-6a25-4dab-b2da-65164cd39bde None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:15.773794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3c5a-6a25-4dab-b2da-65164cd39bde None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:15.809283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:15.809956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:15.810238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:15.810511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:15.811185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:15.811486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:15.812853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:15.822916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 498/1015] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:37:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:15.824398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:15.891806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:15.927940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689223cf-db9b-4afa-809d-94bccca9adde None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:15.962690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f635-a8c5-4c1b-945a-fa1456e017e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:15.963309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f635-a8c5-4c1b-945a-fa1456e017e2 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:15.963588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f635-a8c5-4c1b-945a-fa1456e017e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:15.963859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f635-a8c5-4c1b-945a-fa1456e017e2 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:15.964535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f635-a8c5-4c1b-945a-fa1456e017e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:15.964871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f635-a8c5-4c1b-945a-fa1456e017e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:15.966243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f635-a8c5-4c1b-945a-fa1456e017e2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:15.976309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 518/1016] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 1 15:37:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:15.977988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:16.029074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:16.084175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d2c4d-6a53-4c63-8dc0-83fd24b03c82 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:16.119267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1a4cf-e682-4df5-a9aa-28a8e3e24414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:16.119887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a4cf-e682-4df5-a9aa-28a8e3e24414 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:16.120173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a4cf-e682-4df5-a9aa-28a8e3e24414 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:16.120453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a4cf-e682-4df5-a9aa-28a8e3e24414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:16.121161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1a4cf-e682-4df5-a9aa-28a8e3e24414 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:16.122581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1a4cf-e682-4df5-a9aa-28a8e3e24414 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:16.374230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55baa92-df67-4b36-93c7-e505c6406cdc None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:16.374525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55baa92-df67-4b36-93c7-e505c6406cdc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:16.374816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55baa92-df67-4b36-93c7-e505c6406cdc None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:16.376889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 519/1017] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:16.382026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3212eb-36e2-4165-8138-a403a7c37cc7 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:16.382313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3212eb-36e2-4165-8138-a403a7c37cc7 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:16.382587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3212eb-36e2-4165-8138-a403a7c37cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:16.401221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1d3212eb-36e2-4165-8138-a403a7c37cc7 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:16.402487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1d3212eb-36e2-4165-8138-a403a7c37cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:16.471725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 520/1018] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:16.494187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3212eb-36e2-4165-8138-a403a7c37cc7 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:16.513409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 499/1019] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:16.568658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:16.609791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3212eb-36e2-4165-8138-a403a7c37cc7 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:16.651611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b3958-2412-4b0f-9255-51f3dcdee21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:16.652352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b3958-2412-4b0f-9255-51f3dcdee21e None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:16.652542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b3958-2412-4b0f-9255-51f3dcdee21e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:16.652807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b3958-2412-4b0f-9255-51f3dcdee21e None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:16.653499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b3958-2412-4b0f-9255-51f3dcdee21e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:16.654948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b3958-2412-4b0f-9255-51f3dcdee21e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:16.933951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 521/1020] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:37:16 2022] POST /identity/v3/services => generated 242 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:37:17.328257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c646ad-6034-46dc-9666-46d694cc1599 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:17.328823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c646ad-6034-46dc-9666-46d694cc1599 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:17.328823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c646ad-6034-46dc-9666-46d694cc1599 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:17.331003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 500/1021] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:17.336467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e45a-be08-4fcf-bc96-6cddd1db61c7 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:17.336764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e45a-be08-4fcf-bc96-6cddd1db61c7 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:17.337046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e45a-be08-4fcf-bc96-6cddd1db61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:17.356751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d8d1e45a-be08-4fcf-bc96-6cddd1db61c7 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:17.358032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d8d1e45a-be08-4fcf-bc96-6cddd1db61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:17.444113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 522/1022] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:17.470541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c646ad-6034-46dc-9666-46d694cc1599 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:17.607302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c646ad-6034-46dc-9666-46d694cc1599 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:17.607302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:17.634453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b0c49-f3a8-4e17-9f8d-9c42083dbe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:17.635111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0c49-f3a8-4e17-9f8d-9c42083dbe47 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:17.635393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0c49-f3a8-4e17-9f8d-9c42083dbe47 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:17.635668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0c49-f3a8-4e17-9f8d-9c42083dbe47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:17.636959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b0c49-f3a8-4e17-9f8d-9c42083dbe47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:17.638709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b0c49-f3a8-4e17-9f8d-9c42083dbe47 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:17.645379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 501/1023] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:17.647066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e45a-be08-4fcf-bc96-6cddd1db61c7 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:17.710443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:17.780619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e45a-be08-4fcf-bc96-6cddd1db61c7 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:17.816975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069729c-b2e6-49ef-becb-3ed60b613337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:17.817624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069729c-b2e6-49ef-becb-3ed60b613337 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:17.817912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069729c-b2e6-49ef-becb-3ed60b613337 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:17.818190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069729c-b2e6-49ef-becb-3ed60b613337 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:17.818899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069729c-b2e6-49ef-becb-3ed60b613337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:17.820327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069729c-b2e6-49ef-becb-3ed60b613337 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:17.960005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 523/1024] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:37:17 2022] POST /identity/v3/users => generated 285 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:18.639092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268eccf9-dafd-4a36-bef9-7813747a1565 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:18.639596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268eccf9-dafd-4a36-bef9-7813747a1565 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:18.639596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268eccf9-dafd-4a36-bef9-7813747a1565 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:18.640972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 502/1025] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:18.646264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17520-11a4-4891-8b6e-926546b11f25 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:18.646683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17520-11a4-4891-8b6e-926546b11f25 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:18.646870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17520-11a4-4891-8b6e-926546b11f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:18.665037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-46b17520-11a4-4891-8b6e-926546b11f25 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:18.666250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-46b17520-11a4-4891-8b6e-926546b11f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:18.734965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 524/1026] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:18.758433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268eccf9-dafd-4a36-bef9-7813747a1565 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:18.861299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268eccf9-dafd-4a36-bef9-7813747a1565 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:18.895060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1af989-af84-4918-9d5f-71b4db42f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:18.895632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af989-af84-4918-9d5f-71b4db42f280 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:18.895916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af989-af84-4918-9d5f-71b4db42f280 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:18.896196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af989-af84-4918-9d5f-71b4db42f280 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:18.906269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1af989-af84-4918-9d5f-71b4db42f280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5e1af989-af84-4918-9d5f-71b4db42f280 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:18.911723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:18.912643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:18.913542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:18.920961 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 503/1027] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 1 15:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:18.921102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17520-11a4-4891-8b6e-926546b11f25 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:18.949504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:18.993203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fef1b-03f2-47da-a644-8d8f2c83e3ee None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:18.994117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fef1b-03f2-47da-a644-8d8f2c83e3ee None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:18.994414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fef1b-03f2-47da-a644-8d8f2c83e3ee None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:18.996033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 504/1028] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:19.001002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e3038-89e5-41a3-a02b-12dd8005ec62 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.001352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e3038-89e5-41a3-a02b-12dd8005ec62 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.001672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e3038-89e5-41a3-a02b-12dd8005ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.019413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-6e2e3038-89e5-41a3-a02b-12dd8005ec62 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:19.020605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6e2e3038-89e5-41a3-a02b-12dd8005ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:19.026024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17520-11a4-4891-8b6e-926546b11f25 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.047567 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.065345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.066288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.066806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.067233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.068121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:19.068617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.070254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.079382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 525/1029] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 1 15:37:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:19.086315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.099877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 505/1030] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:19.122329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e3038-89e5-41a3-a02b-12dd8005ec62 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.188419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.197011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287e6a-ff46-43a4-b0f0-4aaa74c58371 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.232892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.233671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.233888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e3038-89e5-41a3-a02b-12dd8005ec62 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.233993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.234227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.245028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.246529 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:19.260861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:19.261809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:19.262854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:19.262854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:19.262854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:19.262854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:19.262854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 526/1031] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:19.268163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.270870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.272124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.272124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.272124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] PATH_INFO: `/v3/services/image` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.272666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.277042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:19.289357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:19.290613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:19.292081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 506/1032] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:19.297023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.326566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.388938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35264d-382d-4eb2-88a9-bc3f09fe45eb None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.405592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac59a-932d-4c26-9ffc-3ba8578f11ed None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.424241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.424859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.425139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.425413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.426129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:19.426828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.428213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.440214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 527/1033] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:19.442853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.443474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.443755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.444027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.444793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] RBAC: Adding query filter params (name=image) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:19.445124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.445618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.446522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.449551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.452238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 507/1034] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:19.458815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.553358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.555963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767d274-9b43-43dc-85c2-c0f80807b9b5 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.566721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bc6b-7ce6-43b0-b170-f97275ab76d6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.595200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.595845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.596134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.596412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.603871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.604079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.604663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.604947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.605225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.605344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.605936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] RBAC: Adding query filter params (type=image) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:19.606265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.607702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.617697 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 508/1035] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:37:19.618204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:19.619201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:37:19.620635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:19.621284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.621375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 528/1036] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:19.624722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.692693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.725585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc137122-90d3-47c0-b2e7-a1394e08941a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.734015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a7da-514b-4099-b5b7-65b9e76e96d1 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.761942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.762819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.763276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.763720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.764623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] RBAC: Adding query filter params (interface=public, service_id=716444fbe7ef479d8a84c36f28f0022d, region_id=RegionOne) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:19.765100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.767071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.773087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.773657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 509/1037] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/endpoints?service_id=716444fbe7ef479d8a84c36f28f0022d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:19.777987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.778280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.778621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.778934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.779431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:19.779748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.781173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.797912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.801786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 529/1038] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:19.807907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:19.886671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e36856-ce47-4f5b-a6b3-636167d4a1a0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.913907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee74bb-0e1e-408d-8179-021113b2feb4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:19.919896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112fd8e-c587-49a1-8873-70ed84741dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.920526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fd8e-c587-49a1-8873-70ed84741dca None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.920810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fd8e-c587-49a1-8873-70ed84741dca None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.921089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fd8e-c587-49a1-8873-70ed84741dca None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:19.921778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112fd8e-c587-49a1-8873-70ed84741dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:19.923727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112fd8e-c587-49a1-8873-70ed84741dca None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:19.941543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 510/1039] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:37:19.951839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.966053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:19.967524 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:19.967821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:19.968099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.044019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.045635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.064564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0766e4-123f-4ec9-bad6-3ea12bf2fbce None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.064854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0766e4-123f-4ec9-bad6-3ea12bf2fbce None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.065136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0766e4-123f-4ec9-bad6-3ea12bf2fbce None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.066548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 511/1040] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:20.075009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532c9d-85bc-48fa-8eb0-62128d954ee6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.075329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532c9d-85bc-48fa-8eb0-62128d954ee6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.075578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532c9d-85bc-48fa-8eb0-62128d954ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.096897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-71532c9d-85bc-48fa-8eb0-62128d954ee6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:20.098261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-71532c9d-85bc-48fa-8eb0-62128d954ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:20.160143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 530/1041] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:37:20.161191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.175800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 512/1042] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:20.186132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.199166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71532c9d-85bc-48fa-8eb0-62128d954ee6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.213040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.266652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aacb8-0f63-41bc-89a2-46638ff028aa None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.305667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71532c9d-85bc-48fa-8eb0-62128d954ee6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.307653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.309126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.309416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.309723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.322353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.324010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:20.339115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:20.340068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:20.341733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:20.341733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:20.341733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:20.341733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:20.341733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 531/1043] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:20.343644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.344844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.345170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.345689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.346444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.356627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:20.362180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:20.363100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:20.364116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 513/1044] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:20.369151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.438780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.459539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.464377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cea212-81b5-4e21-8302-071ae2072f45 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.492426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bca109-e16f-4c0b-beb9-b432ef6526a2 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.500547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.501296 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.501611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.501890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.502578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:20.502884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.504365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.517558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 532/1045] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:20.522450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.529657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.530438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.531201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.531481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.532695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:20.533320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.535054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.544052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 514/1046] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:20.549913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.627657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199cf1e-ddc1-4ed4-b31a-c24ec08fcea3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.656319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da216a-0ab7-48e4-83b6-21060e69a586 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.663118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.663758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.664036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.664420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.666346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.671555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.673813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:37:20.685285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:20.686372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:20.687613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 533/1047] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:20.692205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.697756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.698579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.699000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.699470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] PATH_INFO: `/v3/users/b7b16aaf026b483090af53e03108c5b5` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.701656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.715260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b16aaf026b483090af53e03108c5b5)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.716631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.723698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 515/1048] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/users/b7b16aaf026b483090af53e03108c5b5 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:20.724506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.800809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3cddf-12fb-4a7c-835f-495b4a531e00 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.833249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb18c-60ec-49e7-966b-c674ce486fa8 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:20.837198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.838058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.838526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.838984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.840072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:20.840579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.842127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.854561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 534/1049] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:20.860530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:20.869248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:20.869905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:20.870197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:20.870482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:20.919995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.935414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:20.945380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:20.946947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:20.966316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a082f-f642-4cf1-86f8-f6959191344d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:21.004962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:21.005941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:21.006406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:21.006822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:21.007884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] RBAC: Adding query filter params (role.id=75132a9b62df4ff3a0f1289c31c4b68b, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=784ac400fc5643a589d79d0314ee4a19) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:21.008380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:21.010076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:21.016868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 535/1050] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/role_assignments?user.id=784ac400fc5643a589d79d0314ee4a19&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=75132a9b62df4ff3a0f1289c31c4b68b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:21.056667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 516/1051] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:21.063538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:21.179341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec572f0-38e4-4f06-b9dd-b5e1b641b9c0 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:21.198691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:21.215261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cdc2b-49e2-4061-8260-fb4519e3a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:21.221747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc2b-49e2-4061-8260-fb4519e3a366 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:21.221747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc2b-49e2-4061-8260-fb4519e3a366 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:21.221747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc2b-49e2-4061-8260-fb4519e3a366 None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:21.221747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cdc2b-49e2-4061-8260-fb4519e3a366 None admin] RBAC: Authorizing `identity:get_project(project_id=d362ff349e24473e8587c6d52fad3fb2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:21.221747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cdc2b-49e2-4061-8260-fb4519e3a366 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:21.221747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 536/1052] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:21 2022] GET /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:21.226609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:21.325814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:21.334958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c15d5-eea5-4ad7-b2d8-aae498584a1b None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:21.368338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5faef-6b4e-4cbb-8ecf-c5aa8c98295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:21.368960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5faef-6b4e-4cbb-8ecf-c5aa8c98295f None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:21.369241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5faef-6b4e-4cbb-8ecf-c5aa8c98295f None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:21.369511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5faef-6b4e-4cbb-8ecf-c5aa8c98295f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:21.370315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5faef-6b4e-4cbb-8ecf-c5aa8c98295f None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=d362ff349e24473e8587c6d52fad3fb2, user.id=b7b16aaf026b483090af53e03108c5b5) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:21.370950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5faef-6b4e-4cbb-8ecf-c5aa8c98295f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:21.372358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5faef-6b4e-4cbb-8ecf-c5aa8c98295f None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:21.385777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 517/1053] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:21 2022] GET /identity/v3/role_assignments?user.id=b7b16aaf026b483090af53e03108c5b5&scope.project.id=d362ff349e24473e8587c6d52fad3fb2&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:21.963191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d4b4-7061-4c23-81f2-4da853f43ff8 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:21.963748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d4b4-7061-4c23-81f2-4da853f43ff8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:21.963748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d4b4-7061-4c23-81f2-4da853f43ff8 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:21.965246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 537/1054] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:21.970387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88b18-f327-4342-8679-d674e4add669 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:21.970815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88b18-f327-4342-8679-d674e4add669 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:21.970960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88b18-f327-4342-8679-d674e4add669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:21.990447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2be88b18-f327-4342-8679-d674e4add669 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:21.991643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2be88b18-f327-4342-8679-d674e4add669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:22.058866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 518/1055] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:22.081856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d4b4-7061-4c23-81f2-4da853f43ff8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:22.187603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d4b4-7061-4c23-81f2-4da853f43ff8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:22.222117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:22.222679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:22.222962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:22.223241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] PATH_INFO: `/v3/services/image` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:22.223865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:22.225239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:22.233910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:22.235496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:37:22.236352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:22.243868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 538/1056] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Aug 1 15:37:22 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:22.244071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88b18-f327-4342-8679-d674e4add669 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:22.336678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:22.351052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88b18-f327-4342-8679-d674e4add669 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:22.385208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:22.385860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:22.386147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:22.386427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:22.387105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] RBAC: Adding query filter params (name=image) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:22.387413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:22.388815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:22.398359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 519/1057] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:22.399388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:22.452564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:22.510620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0ef67-4929-4f0d-8c97-b0e7a2e8ca56 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:22.546532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983f2c4-db0f-4340-bec7-b09450e33ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:22.547153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f2c4-db0f-4340-bec7-b09450e33ea5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:22.547975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f2c4-db0f-4340-bec7-b09450e33ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:22.548252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f2c4-db0f-4340-bec7-b09450e33ea5 None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:22.548935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983f2c4-db0f-4340-bec7-b09450e33ea5 None admin] RBAC: Adding query filter params (type=image) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:22.549242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983f2c4-db0f-4340-bec7-b09450e33ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:22.550650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983f2c4-db0f-4340-bec7-b09450e33ea5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:22.556108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 539/1058] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:22.561852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:22.664216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e7fd-127c-4305-9821-5baecf33bf2a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:22.698010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3d8f-5155-49ba-b166-3cad23d6703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:22.698635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3d8f-5155-49ba-b166-3cad23d6703b None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:22.698922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3d8f-5155-49ba-b166-3cad23d6703b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:22.699206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3d8f-5155-49ba-b166-3cad23d6703b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:22.699973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3d8f-5155-49ba-b166-3cad23d6703b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:22.701378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3d8f-5155-49ba-b166-3cad23d6703b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:22.801921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 520/1059] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:37:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:23.052612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7b35-eda5-48b8-b356-23bb866fb924 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.053101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7b35-eda5-48b8-b356-23bb866fb924 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.053101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7b35-eda5-48b8-b356-23bb866fb924 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.054488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 540/1060] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:23.059827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a0e9a-388f-43af-9dac-7e5286cb77fe None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.060262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a0e9a-388f-43af-9dac-7e5286cb77fe None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.060456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a0e9a-388f-43af-9dac-7e5286cb77fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.073212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:23.080208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f85a0e9a-388f-43af-9dac-7e5286cb77fe None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:23.081396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f85a0e9a-388f-43af-9dac-7e5286cb77fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:23.155955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 521/1061] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:23.178973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7b35-eda5-48b8-b356-23bb866fb924 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.284991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7b35-eda5-48b8-b356-23bb866fb924 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:23.300267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:23.319893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352846ab-2a8a-46ef-a6e1-33f5da490c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:23.320463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352846ab-2a8a-46ef-a6e1-33f5da490c60 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.320744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352846ab-2a8a-46ef-a6e1-33f5da490c60 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.321015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352846ab-2a8a-46ef-a6e1-33f5da490c60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.331763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352846ab-2a8a-46ef-a6e1-33f5da490c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-352846ab-2a8a-46ef-a6e1-33f5da490c60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:23.336955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:23.338090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:23.339090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:23.345897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 541/1062] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:23.348118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a0e9a-388f-43af-9dac-7e5286cb77fe None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.374847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4e3f-f95a-4337-9f52-19c7f5cfc422 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.375137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4e3f-f95a-4337-9f52-19c7f5cfc422 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.375993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4e3f-f95a-4337-9f52-19c7f5cfc422 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.378055 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 542/1063] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:23.384993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a995ed-de45-44c9-9d18-bb1659c826e8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.385280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a995ed-de45-44c9-9d18-bb1659c826e8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.385580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a995ed-de45-44c9-9d18-bb1659c826e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.405044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-13a995ed-de45-44c9-9d18-bb1659c826e8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:23.406256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-13a995ed-de45-44c9-9d18-bb1659c826e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:23.465272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a0e9a-388f-43af-9dac-7e5286cb77fe None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:23.482402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 543/1064] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:23.499421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:23.504961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a995ed-de45-44c9-9d18-bb1659c826e8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.505112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:23.505760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.506047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.506325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.507051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:23.507364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:23.508883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:23.525194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 522/1065] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:23.526330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.628396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a995ed-de45-44c9-9d18-bb1659c826e8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:23.631542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:23.634719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021bdea-d15d-439f-a9f7-f2ff83a48e7d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:23.664134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:23.664766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.665813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.665813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.671062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:23.671699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.671986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.672292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.675939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:23.681083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:23.682172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:23.683813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 544/1066] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:23.686107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:23.688388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:23.688649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:23.706414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:23.707456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:23.708386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:23.708386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:23.708386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:23.708386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:23.708386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 523/1067] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:23.713297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.765140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:23.794519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104ed92-524d-4453-a7cd-053b715d027b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:23.823741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b599b-8359-46a7-9bf5-c5f1982a4ebe None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:23.833289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:23.834548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.835236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.835669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.836838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:23.837692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:23.839723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:23.854352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 545/1068] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:23.861701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.864589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:23.865942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:23.866246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:23.866521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:23.867231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:23.867535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:23.870832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:23.892355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 524/1069] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:23.893317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:23.897618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:23.989911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081356-d996-4d08-9c4b-295797223b0e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.002693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f44d-d3f0-44ba-a665-93a484e944af None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.010148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:24.028467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.029116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.029402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.029752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] PATH_INFO: `/v3/users/b7b16aaf026b483090af53e03108c5b5` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.030917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b16aaf026b483090af53e03108c5b5)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.033004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.038399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.039045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.039631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.039734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 546/1070] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/users/b7b16aaf026b483090af53e03108c5b5 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:24.039916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.040488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.048721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.050488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:37:24.062457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:24.064104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:24.070003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 525/1071] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:37:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:24.070811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.147272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:24.154476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca326c1-4b26-428f-be41-adb1a2fc8953 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.180877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcb183-d67c-4c2a-94b0-246cc84f9e80 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.193605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.194447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.194727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.195000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.196156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] RBAC: Authorizing `identity:get_project(project_id=d362ff349e24473e8587c6d52fad3fb2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.197674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.199390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 547/1072] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:24 2022] GET /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:24.205172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.223628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.224459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.224749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.225029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.225912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:24.226226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.227866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.247598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 526/1073] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:37:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:24.252727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.282823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:24.316957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957523d-01db-4df9-9eae-e8fc49f5bbdf None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.354429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.355493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.355493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.355739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2/users/b7b16aaf026b483090af53e03108c5b5/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.358301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] RBAC: Authorizing `identity:create_grant(project_id=d362ff349e24473e8587c6d52fad3fb2, user_id=b7b16aaf026b483090af53e03108c5b5, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.360473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.366299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca8f05-960e-478a-8a0a-4e29e92a0156 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.399896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.400466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.400749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.401024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.411841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.413293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:24.428692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:24.429761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:24.431261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:24.431261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:24.431261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:24.431261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:24.431261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 527/1074] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:24.435666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.445668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 548/1075] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:37:24 2022] PUT /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2/users/b7b16aaf026b483090af53e03108c5b5/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:24.532284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:24.556476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7463f8-14b5-4916-9a6f-c7944da16e2e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.601823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.602470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.602762 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.603045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.603759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:24.604072 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.605624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.618718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 528/1076] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:24.624449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.651056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:24.730063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c34f09-e060-4634-a0ef-a6e2a46e4096 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.764046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908071d-2211-4bf2-b8d9-54b517e7ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.765011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908071d-2211-4bf2-b8d9-54b517e7ede8 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.765441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908071d-2211-4bf2-b8d9-54b517e7ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.766448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908071d-2211-4bf2-b8d9-54b517e7ede8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.773463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908071d-2211-4bf2-b8d9-54b517e7ede8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.775086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908071d-2211-4bf2-b8d9-54b517e7ede8 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-5908071d-2211-4bf2-b8d9-54b517e7ede8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:37:24.787854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:24.788835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:24.789840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 549/1077] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:24.796259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.848141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85423d-108d-42ae-9037-9c99cf6073aa None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.848744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85423d-108d-42ae-9037-9c99cf6073aa None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.849028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85423d-108d-42ae-9037-9c99cf6073aa None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.850608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 550/1078] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:37:24.855321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d612c-7f71-4790-a019-356cc5c212ae None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.855609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d612c-7f71-4790-a019-356cc5c212ae None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.855888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d612c-7f71-4790-a019-356cc5c212ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.874531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d64d612c-7f71-4790-a019-356cc5c212ae None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:24.876210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d64d612c-7f71-4790-a019-356cc5c212ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:24.910627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013a18-d2ef-4e4d-8ebd-f9ff2a71e97c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:24.949286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:24.950086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:24.950461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:24.950830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:24.951524 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 551/1079] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:24.951793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:24.952228 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:24.954353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:24.959123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:24.974064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 529/1080] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:24.975440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.975579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d612c-7f71-4790-a019-356cc5c212ae None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:24.991116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:25.084879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d612c-7f71-4790-a019-356cc5c212ae None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:25.085391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c31532-72b8-4680-8c56-a71c56bf6cc9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:25.120572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:25.121137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:25.121402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:25.121772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:25.121965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:25.122206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/784ac400fc5643a589d79d0314ee4a19/roles/75132a9b62df4ff3a0f1289c31c4b68b` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:25.122359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:25.122720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:25.124548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=784ac400fc5643a589d79d0314ee4a19, role_id=75132a9b62df4ff3a0f1289c31c4b68b)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:25.126606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:25.184887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:25.192450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:25.193952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:25.222914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 552/1081] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:37:24 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/784ac400fc5643a589d79d0314ee4a19/roles/75132a9b62df4ff3a0f1289c31c4b68b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:37:25.308351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 530/1082] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:25.317315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:25.395278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:25.424913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809045a-e03c-47be-a22e-176d662f1cf1 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:25.461257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddd807-ffd9-4b25-8897-1729d2e7c429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:25.461863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddd807-ffd9-4b25-8897-1729d2e7c429 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:25.462150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddd807-ffd9-4b25-8897-1729d2e7c429 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:25.462427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddd807-ffd9-4b25-8897-1729d2e7c429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:25.472825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddd807-ffd9-4b25-8897-1729d2e7c429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:25.474333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddd807-ffd9-4b25-8897-1729d2e7c429 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-2bddd807-ffd9-4b25-8897-1729d2e7c429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:25.489862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:25.490815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:25.491695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:25.491695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:25.491695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:25.491695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:25.492292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 553/1083] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:25.497607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:25.596382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:25.602637 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4598fe-e8d0-42e0-a0a3-2add7dab06a4 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:25.636197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd863f-6d18-4714-859e-641c14699387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:25.636824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd863f-6d18-4714-859e-641c14699387 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:25.637111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd863f-6d18-4714-859e-641c14699387 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:25.637435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd863f-6d18-4714-859e-641c14699387 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:25.638155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd863f-6d18-4714-859e-641c14699387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:25.638467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd863f-6d18-4714-859e-641c14699387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:25.639848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd863f-6d18-4714-859e-641c14699387 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:25.657555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 531/1084] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:26.469812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041b0a-9d31-4e47-82ab-86fc513b10d7 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:26.470376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041b0a-9d31-4e47-82ab-86fc513b10d7 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:26.470376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041b0a-9d31-4e47-82ab-86fc513b10d7 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:26.472087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 554/1085] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:26.477687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078bb2-6970-4180-a3c0-f6aff4085515 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:26.478136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078bb2-6970-4180-a3c0-f6aff4085515 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:26.478259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078bb2-6970-4180-a3c0-f6aff4085515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:26.496095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ad078bb2-6970-4180-a3c0-f6aff4085515 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:26.497273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ad078bb2-6970-4180-a3c0-f6aff4085515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:26.563716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 532/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:26.587306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3041b0a-9d31-4e47-82ab-86fc513b10d7 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:26.688232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3041b0a-9d31-4e47-82ab-86fc513b10d7 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:26.711331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:26.721430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:26.722089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:26.722369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:26.722643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:26.732747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:26.738443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:26.739556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:26.740589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 555/1087] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:37:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:26.747558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078bb2-6970-4180-a3c0-f6aff4085515 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:26.834013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:26.848445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078bb2-6970-4180-a3c0-f6aff4085515 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:26.882613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:26.883236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:26.883520 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:26.883800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:26.884518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:26.884829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:26.886242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:26.894598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 533/1088] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:37:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:26.900506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:27.003079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9601-4723-417a-8f15-cfac17e2add1 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:27.038325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a18132-52af-4aa6-bd3a-7b8a3f9430da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:27.038972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a18132-52af-4aa6-bd3a-7b8a3f9430da None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.039260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a18132-52af-4aa6-bd3a-7b8a3f9430da None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.039542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a18132-52af-4aa6-bd3a-7b8a3f9430da None admin] PATH_INFO: `/v3/users/b7b16aaf026b483090af53e03108c5b5` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.040720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a18132-52af-4aa6-bd3a-7b8a3f9430da None admin] RBAC: Authorizing `identity:get_user(user_id=b7b16aaf026b483090af53e03108c5b5)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:27.042210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a18132-52af-4aa6-bd3a-7b8a3f9430da None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:27.044456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 556/1089] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:26 2022] GET /identity/v3/users/b7b16aaf026b483090af53e03108c5b5 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:27.050793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:27.154128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55c69a-62d7-4e57-ad34-ded2da69a101 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:27.188376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:27.189034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.189318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.189632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.207240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:27.257840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:27.259314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:27.297947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3739a-ca1c-480f-b7c5-41204b8d3db1 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.298236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3739a-ca1c-480f-b7c5-41204b8d3db1 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.298511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3739a-ca1c-480f-b7c5-41204b8d3db1 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.299865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 557/1090] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:27.306056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fbd1-7ded-41b1-8417-d578bebf90db None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.306562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fbd1-7ded-41b1-8417-d578bebf90db None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.306942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fbd1-7ded-41b1-8417-d578bebf90db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.325433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-cee7fbd1-7ded-41b1-8417-d578bebf90db None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:27.326628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cee7fbd1-7ded-41b1-8417-d578bebf90db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:27.365232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 534/1091] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:27.371045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:27.376472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:27.400010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 558/1092] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:27.422826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fbd1-7ded-41b1-8417-d578bebf90db None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:27.424616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:27.475723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e9a4a-8883-4188-b3a9-9bd9e1d524ea None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:27.508877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:27.509613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.509816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.510095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.511259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=d362ff349e24473e8587c6d52fad3fb2)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:27.512711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:27.514632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 535/1093] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:27 2022] GET /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:27.520884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:27.528464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fbd1-7ded-41b1-8417-d578bebf90db None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:27.570956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:27.571600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.571878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.572156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.583300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:27.588800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:27.590615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:27.591584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 559/1094] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 1 15:37:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:27.596639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:27.622172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd34ba-813b-4dd7-bddc-3f39214e0fe0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:27.639058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:27.642226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:27.657821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:27.658459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.658741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.659018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.659807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=d362ff349e24473e8587c6d52fad3fb2, user.id=b7b16aaf026b483090af53e03108c5b5) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:27.660120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:27.661636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:27.667757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 536/1095] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:27 2022] GET /identity/v3/role_assignments?user.id=b7b16aaf026b483090af53e03108c5b5&scope.project.id=d362ff349e24473e8587c6d52fad3fb2&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:27.707593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b33706-9818-404a-a145-50ff8a9341bd None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:27.745947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:27.747030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.747483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.747946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.749162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:27.749713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:27.752118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:27.761358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 560/1096] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 1 15:37:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:27.767946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:27.878435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ec90d-2702-4a18-a7f2-abf01ad2e835 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:27.911796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:27.912438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:27.912724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:27.913005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:27.923435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:27.924881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:27.939624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:27.940659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:27.941787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:27.941787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:27.941787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:27.941787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:27.941787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 537/1097] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:27.946429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.048397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d8bfa-cd81-4978-9ca5-7dadda2ce939 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.050743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.082830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.083477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.083774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.084400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.085275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:28.085864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.087278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:28.099459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 561/1098] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:28.105191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.137522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.211378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daeec0-6708-486f-a705-0cfa1540aa27 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.246675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.247313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.247592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.247863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.255759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.257191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:37:28.268171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:28.269315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:28.270315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 538/1099] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 1 15:37:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:28.275281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.377238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b0bf8-7221-4536-8004-7448ff397417 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.409587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.410205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.410485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.410755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.411544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:28.411850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.413267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:28.430581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 562/1100] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 1 15:37:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:28.436316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.526568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.534908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ef1b2-d9d8-47b9-b42b-183ce898dbf1 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.568948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.569654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.569943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.570219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.636056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.637433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:28.744992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.754180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 539/1101] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:28.760060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:28.784507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.862255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddd583-a6d4-42be-ac0d-c2c3de3fdf60 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:28.894945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:28.895506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.895792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.896072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.906027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:28.908048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:28.922785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:28.923830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:28.924753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:37:28.924753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:28.924753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:37:28.924753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:28.924753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 563/1102] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:37:28.930006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.025476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ce83-58ba-43c3-bb6c-21e303a51a57 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.059115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.059730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.060012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.060288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.060966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.061272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.062692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.073729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 540/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:29.081505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.155613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.179110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b73773-5b78-48e4-8691-ba7211c9e6b6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.212344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.212974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.213254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.213545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.220774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.222250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:37:29.233201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:29.234185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:29.235567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 564/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:29.240173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.298840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.345862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739928f8-24af-413c-9310-a9eeede4e107 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.378384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947643ea-1a27-441a-8b4e-b20cf5e0b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.379000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947643ea-1a27-441a-8b4e-b20cf5e0b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.379284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947643ea-1a27-441a-8b4e-b20cf5e0b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.379559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947643ea-1a27-441a-8b4e-b20cf5e0b1c8 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.380299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947643ea-1a27-441a-8b4e-b20cf5e0b1c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.380606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947643ea-1a27-441a-8b4e-b20cf5e0b1c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.382127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947643ea-1a27-441a-8b4e-b20cf5e0b1c8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.394600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 541/1105] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:29.401010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.498611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15627e9f-f845-454a-b282-601ec43467ab None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.532860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ab7c8-b478-4b41-af92-5d31f45dad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.533481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ab7c8-b478-4b41-af92-5d31f45dad8d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.533849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ab7c8-b478-4b41-af92-5d31f45dad8d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.534076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ab7c8-b478-4b41-af92-5d31f45dad8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.534868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ab7c8-b478-4b41-af92-5d31f45dad8d None admin] RBAC: Adding query filter params (role.id=75132a9b62df4ff3a0f1289c31c4b68b, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=784ac400fc5643a589d79d0314ee4a19) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:29.535179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ab7c8-b478-4b41-af92-5d31f45dad8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.536614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ab7c8-b478-4b41-af92-5d31f45dad8d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.538626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.543158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 565/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/role_assignments?user.id=784ac400fc5643a589d79d0314ee4a19&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=75132a9b62df4ff3a0f1289c31c4b68b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.717133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926d239-63f0-4662-993a-86f84692b1dd None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.717657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926d239-63f0-4662-993a-86f84692b1dd None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.717756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926d239-63f0-4662-993a-86f84692b1dd None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.719129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 542/1107] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:29.724415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1574-38fc-4e51-99f8-0a512a8bd33f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.724707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1574-38fc-4e51-99f8-0a512a8bd33f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.724989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1574-38fc-4e51-99f8-0a512a8bd33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.743971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e26b1574-38fc-4e51-99f8-0a512a8bd33f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:29.745169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e26b1574-38fc-4e51-99f8-0a512a8bd33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:29.814571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 566/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:29.840106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926d239-63f0-4662-993a-86f84692b1dd None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:29.944883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926d239-63f0-4662-993a-86f84692b1dd None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:29.958348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:29.980766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc17ec5-5fd2-4f98-8e49-600a8f2e38e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:29.981410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc17ec5-5fd2-4f98-8e49-600a8f2e38e2 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:29.982062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc17ec5-5fd2-4f98-8e49-600a8f2e38e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:29.982062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc17ec5-5fd2-4f98-8e49-600a8f2e38e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:29.983189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc17ec5-5fd2-4f98-8e49-600a8f2e38e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:29.985123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc17ec5-5fd2-4f98-8e49-600a8f2e38e2 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:29.986763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 543/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:29.992883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b1574-38fc-4e51-99f8-0a512a8bd33f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:30.096656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b1574-38fc-4e51-99f8-0a512a8bd33f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:30.128472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:30.138677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853ed8a-3ba0-4c3e-aceb-e4869697e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:30.139410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853ed8a-3ba0-4c3e-aceb-e4869697e838 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:30.139746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853ed8a-3ba0-4c3e-aceb-e4869697e838 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:30.140026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853ed8a-3ba0-4c3e-aceb-e4869697e838 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:30.140837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853ed8a-3ba0-4c3e-aceb-e4869697e838 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:30.142546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853ed8a-3ba0-4c3e-aceb-e4869697e838 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:30.263151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 567/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:37:29 2022] POST /identity/v3/users => generated 286 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:32.291011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c08c1-42ba-4e37-b23f-b7d5c9e71bc9 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.291578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c08c1-42ba-4e37-b23f-b7d5c9e71bc9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.291578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c08c1-42ba-4e37-b23f-b7d5c9e71bc9 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.293371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 544/1111] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:32.298601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241bd42-c490-45c6-8a9e-78d380349e23 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.299026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241bd42-c490-45c6-8a9e-78d380349e23 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.299163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241bd42-c490-45c6-8a9e-78d380349e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.317962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a241bd42-c490-45c6-8a9e-78d380349e23 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:32.319152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a241bd42-c490-45c6-8a9e-78d380349e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:32.382483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 568/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:37:32.405242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c08c1-42ba-4e37-b23f-b7d5c9e71bc9 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.504670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c08c1-42ba-4e37-b23f-b7d5c9e71bc9 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.537064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.537718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.537998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.538271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] PATH_INFO: `/v3/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.539680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] RBAC: Authorizing `identity:get_role(role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.541098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.542406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 545/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:32.548215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241bd42-c490-45c6-8a9e-78d380349e23 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.645961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241bd42-c490-45c6-8a9e-78d380349e23 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.660086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:32.678723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.679352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.679886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.680157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] PATH_INFO: `/v3/users/47b691fc393f4673a1f73bb0c7d0ec41` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.693797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] RBAC: Authorizing `identity:get_user(user_id=47b691fc393f4673a1f73bb0c7d0ec41)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.698046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.698046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 569/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/users/47b691fc393f4673a1f73bb0c7d0ec41 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:32.702671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.751948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:32.801353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc59514-88ac-47ee-b945-453f88240f92 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:32.834561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:32.835178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.835463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.835742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.900308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:32.901782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:32.947887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:32.998396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 546/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:33.005131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:33.101763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4ee9e-611e-49a0-9d11-732f36ae21f3 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:33.135441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c3f8-1975-450d-8465-20dfe7de2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:33.136072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c3f8-1975-450d-8465-20dfe7de2d5e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.136356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c3f8-1975-450d-8465-20dfe7de2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.136635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c3f8-1975-450d-8465-20dfe7de2d5e None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.137810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299c3f8-1975-450d-8465-20dfe7de2d5e None admin] RBAC: Authorizing `identity:get_project(project_id=d362ff349e24473e8587c6d52fad3fb2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.139254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299c3f8-1975-450d-8465-20dfe7de2d5e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.141016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 570/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:33 2022] GET /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:33.147248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:33.244372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e11f0-c8ee-4df0-ac74-314faef0b719 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:33.276696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46976c63-bd84-46c5-9486-7e0cd04bdb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:33.277295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976c63-bd84-46c5-9486-7e0cd04bdb6e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.277609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976c63-bd84-46c5-9486-7e0cd04bdb6e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.277896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976c63-bd84-46c5-9486-7e0cd04bdb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.278675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46976c63-bd84-46c5-9486-7e0cd04bdb6e None admin] RBAC: Adding query filter params (role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=d362ff349e24473e8587c6d52fad3fb2, user.id=47b691fc393f4673a1f73bb0c7d0ec41) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:33.278994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46976c63-bd84-46c5-9486-7e0cd04bdb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.280420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46976c63-bd84-46c5-9486-7e0cd04bdb6e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.286448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 547/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:33 2022] GET /identity/v3/role_assignments?user.id=47b691fc393f4673a1f73bb0c7d0ec41&scope.project.id=d362ff349e24473e8587c6d52fad3fb2&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:37:35.237463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a480f8-0ed3-437e-b0bf-89b319fd3c49 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.238046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a480f8-0ed3-437e-b0bf-89b319fd3c49 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.238046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a480f8-0ed3-437e-b0bf-89b319fd3c49 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.239409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 571/1118] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:35.244616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c99f-d28e-4bf8-ae32-81b8fb9653d5 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.245216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c99f-d28e-4bf8-ae32-81b8fb9653d5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.245216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c99f-d28e-4bf8-ae32-81b8fb9653d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.263314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e259c99f-d28e-4bf8-ae32-81b8fb9653d5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:35.264490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e259c99f-d28e-4bf8-ae32-81b8fb9653d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:35.271495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:35.329478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 548/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:35.351563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a480f8-0ed3-437e-b0bf-89b319fd3c49 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:35.392969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:35.448863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a480f8-0ed3-437e-b0bf-89b319fd3c49 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:35.480879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:35.481503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.481812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.482084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] PATH_INFO: `/v3/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.483514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] RBAC: Authorizing `identity:get_role(role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:35.485538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:35.486862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 572/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:35 2022] GET /identity/v3/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:35.492852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c99f-d28e-4bf8-ae32-81b8fb9653d5 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:35.587709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c99f-d28e-4bf8-ae32-81b8fb9653d5 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:35.621468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:35.622138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.622423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.622707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] PATH_INFO: `/v3/users/47b691fc393f4673a1f73bb0c7d0ec41` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.623867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] RBAC: Authorizing `identity:get_user(user_id=47b691fc393f4673a1f73bb0c7d0ec41)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:35.625308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:35.626948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 549/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:35 2022] GET /identity/v3/users/47b691fc393f4673a1f73bb0c7d0ec41 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:35.632760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:35.729388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc3797-6fe9-483b-b5e1-b4b6a76af6ee None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:35.738292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:35.761605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c78ff4-7b2e-468d-a592-b6f9146b5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:35.762231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c78ff4-7b2e-468d-a592-b6f9146b5d0d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.762516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c78ff4-7b2e-468d-a592-b6f9146b5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.762796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c78ff4-7b2e-468d-a592-b6f9146b5d0d None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.763941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c78ff4-7b2e-468d-a592-b6f9146b5d0d None admin] RBAC: Authorizing `identity:get_project(project_id=d362ff349e24473e8587c6d52fad3fb2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:35.765924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c78ff4-7b2e-468d-a592-b6f9146b5d0d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:35.767576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 573/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:35 2022] GET /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:35.773644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:35.786260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:35.869424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa3d18-5da0-4421-875c-1a9bdbf9c77c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:35.910324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffb430-7dfb-418a-9815-dfd60109dc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:35.911006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb430-7dfb-418a-9815-dfd60109dc85 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.911293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb430-7dfb-418a-9815-dfd60109dc85 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.911573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb430-7dfb-418a-9815-dfd60109dc85 None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2/users/47b691fc393f4673a1f73bb0c7d0ec41/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.913793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffb430-7dfb-418a-9815-dfd60109dc85 None admin] RBAC: Authorizing `identity:create_grant(project_id=d362ff349e24473e8587c6d52fad3fb2, user_id=47b691fc393f4673a1f73bb0c7d0ec41, role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:35.915241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffb430-7dfb-418a-9815-dfd60109dc85 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:35.987857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 550/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:37:35 2022] PUT /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2/users/47b691fc393f4673a1f73bb0c7d0ec41/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:38.002600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad7168-bbda-4e06-859c-22d6aec8bdbd None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:38.003147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad7168-bbda-4e06-859c-22d6aec8bdbd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:38.003147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad7168-bbda-4e06-859c-22d6aec8bdbd None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:38.004514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 574/1124] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:38.009484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b0413-71b7-4fb6-9f6c-15adbe1cc30b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:38.009945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b0413-71b7-4fb6-9f6c-15adbe1cc30b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:38.010051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b0413-71b7-4fb6-9f6c-15adbe1cc30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:38.028061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a75b0413-71b7-4fb6-9f6c-15adbe1cc30b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:38.029235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a75b0413-71b7-4fb6-9f6c-15adbe1cc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:38.089882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:38.095054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 551/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:38.117846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad7168-bbda-4e06-859c-22d6aec8bdbd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:38.217593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad7168-bbda-4e06-859c-22d6aec8bdbd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:38.251848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:38.252491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:38.252830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:38.253052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] PATH_INFO: `/v3/roles/b6fc9fc30997405ba48f19821f6ef8dc` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:38.254507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] RBAC: Authorizing `identity:get_role(role_id=b6fc9fc30997405ba48f19821f6ef8dc)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:38.255880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:38.257242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 575/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:38 2022] GET /identity/v3/roles/b6fc9fc30997405ba48f19821f6ef8dc => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:38.263203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b0413-71b7-4fb6-9f6c-15adbe1cc30b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:38.365014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b0413-71b7-4fb6-9f6c-15adbe1cc30b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:38.399408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:38.400042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:38.400325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:38.400600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] PATH_INFO: `/v3/users/47b691fc393f4673a1f73bb0c7d0ec41` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:38.401788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] RBAC: Authorizing `identity:get_user(user_id=47b691fc393f4673a1f73bb0c7d0ec41)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:38.403233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:38.404860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 552/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:38 2022] GET /identity/v3/users/47b691fc393f4673a1f73bb0c7d0ec41 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:38.411396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:38.458252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:38.518069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fcf52-e2a3-491e-95bb-4fa6f63950e2 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:38.552085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:38.552703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:38.552982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:38.553252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:38.620064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:38.621557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:38.667468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:38.724352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 576/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:38.730284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:38.793740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:38.824493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c4b9-8345-476b-897a-fd88a831d2ce None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:38.858088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe9796-2652-4e04-9707-d4db461520e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:38.858727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9796-2652-4e04-9707-d4db461520e9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:38.859010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9796-2652-4e04-9707-d4db461520e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:38.859289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9796-2652-4e04-9707-d4db461520e9 None admin] PATH_INFO: `/v3/projects/d362ff349e24473e8587c6d52fad3fb2` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:38.860433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe9796-2652-4e04-9707-d4db461520e9 None admin] RBAC: Authorizing `identity:get_project(project_id=d362ff349e24473e8587c6d52fad3fb2)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:38.861903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe9796-2652-4e04-9707-d4db461520e9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:38.863581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 553/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:38 2022] GET /identity/v3/projects/d362ff349e24473e8587c6d52fad3fb2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:38.869725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:38.966727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4362-b3a6-41e4-9a03-cf67e4afe4da None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:39.001307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f64f3-f4c9-4fae-a32e-07b1e84fcd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:39.001951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f64f3-f4c9-4fae-a32e-07b1e84fcd8c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.002243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f64f3-f4c9-4fae-a32e-07b1e84fcd8c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.002522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f64f3-f4c9-4fae-a32e-07b1e84fcd8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.003311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f64f3-f4c9-4fae-a32e-07b1e84fcd8c None admin] RBAC: Adding query filter params (role.id=b6fc9fc30997405ba48f19821f6ef8dc, scope.project.id=d362ff349e24473e8587c6d52fad3fb2, user.id=47b691fc393f4673a1f73bb0c7d0ec41) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:39.003906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f64f3-f4c9-4fae-a32e-07b1e84fcd8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:39.005050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f64f3-f4c9-4fae-a32e-07b1e84fcd8c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:39.010862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 577/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:38 2022] GET /identity/v3/role_assignments?user.id=47b691fc393f4673a1f73bb0c7d0ec41&scope.project.id=d362ff349e24473e8587c6d52fad3fb2&role.id=b6fc9fc30997405ba48f19821f6ef8dc => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:41.030966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8d453-c400-473d-9946-483ce62316c5 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:41.031495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8d453-c400-473d-9946-483ce62316c5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:41.031495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8d453-c400-473d-9946-483ce62316c5 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:41.032884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 554/1131] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:41.038289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f148e5f-b06f-43b0-a399-5b281509d854 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:41.038711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f148e5f-b06f-43b0-a399-5b281509d854 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:41.038831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f148e5f-b06f-43b0-a399-5b281509d854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:41.057527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3f148e5f-b06f-43b0-a399-5b281509d854 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:41.058770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3f148e5f-b06f-43b0-a399-5b281509d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:41.060921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:41.125597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 578/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:41.148211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8d453-c400-473d-9946-483ce62316c5 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:41.248015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8d453-c400-473d-9946-483ce62316c5 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:41.281346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c76c6-60f2-42bb-9539-8e545727fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:41.281945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c76c6-60f2-42bb-9539-8e545727fb5d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:41.282233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c76c6-60f2-42bb-9539-8e545727fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:41.282513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c76c6-60f2-42bb-9539-8e545727fb5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:41.283697 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c76c6-60f2-42bb-9539-8e545727fb5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:41.285128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c76c6-60f2-42bb-9539-8e545727fb5d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:41.286825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 555/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:41.292812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f148e5f-b06f-43b0-a399-5b281509d854 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:41.391908 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f148e5f-b06f-43b0-a399-5b281509d854 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:41.426938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7e21-26ef-4f90-a546-cdf3df734ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:41.427592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7e21-26ef-4f90-a546-cdf3df734ea5 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:41.427880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7e21-26ef-4f90-a546-cdf3df734ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:41.428161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7e21-26ef-4f90-a546-cdf3df734ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:41.428852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7e21-26ef-4f90-a546-cdf3df734ea5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:41.430636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7e21-26ef-4f90-a546-cdf3df734ea5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:41.440549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:41.587010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 579/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:37:41 2022] POST /identity/v3/projects => generated 311 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:43.634191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe460b-1d2e-4b8e-8836-0989c21427d6 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.634706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe460b-1d2e-4b8e-8836-0989c21427d6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.634706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe460b-1d2e-4b8e-8836-0989c21427d6 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.636023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 556/1135] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:43.641054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bb66-647f-4fa9-b84c-6ed97f71eacf None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.641499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bb66-647f-4fa9-b84c-6ed97f71eacf None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.641616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0bb66-647f-4fa9-b84c-6ed97f71eacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.660791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7ee0bb66-647f-4fa9-b84c-6ed97f71eacf None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:43.661993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7ee0bb66-647f-4fa9-b84c-6ed97f71eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:43.742159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 580/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:43.766154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe460b-1d2e-4b8e-8836-0989c21427d6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:43.769965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:43.865640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe460b-1d2e-4b8e-8836-0989c21427d6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:43.897609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbd9f-bead-404b-a3b0-36d9e9a0ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:43.898137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbd9f-bead-404b-a3b0-36d9e9a0ba68 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.898423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbd9f-bead-404b-a3b0-36d9e9a0ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.898702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbd9f-bead-404b-a3b0-36d9e9a0ba68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.899845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbd9f-bead-404b-a3b0-36d9e9a0ba68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:43.901275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbd9f-bead-404b-a3b0-36d9e9a0ba68 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:43.902902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 557/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:37:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:43.909174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bb66-647f-4fa9-b84c-6ed97f71eacf None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:44.005783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0bb66-647f-4fa9-b84c-6ed97f71eacf None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:44.025253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:44.039077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57be2d2-d1a7-4520-952d-c5ac0428b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:44.043682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be2d2-d1a7-4520-952d-c5ac0428b379 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:44.043682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be2d2-d1a7-4520-952d-c5ac0428b379 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:44.043682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be2d2-d1a7-4520-952d-c5ac0428b379 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:44.043682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57be2d2-d1a7-4520-952d-c5ac0428b379 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:44.043682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57be2d2-d1a7-4520-952d-c5ac0428b379 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:44.181761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 581/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:37:43 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:37:46.250353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a66eb-1b66-4372-b66c-2c8e5674daa8 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.250915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a66eb-1b66-4372-b66c-2c8e5674daa8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.250915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a66eb-1b66-4372-b66c-2c8e5674daa8 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.252239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 558/1139] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:46.257416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47b6c-4bc6-4663-867b-d7127d915f05 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.257819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47b6c-4bc6-4663-867b-d7127d915f05 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.258011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47b6c-4bc6-4663-867b-d7127d915f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.275947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1cf47b6c-4bc6-4663-867b-d7127d915f05 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:46.277065 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1cf47b6c-4bc6-4663-867b-d7127d915f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.345594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 582/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:46.369427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a66eb-1b66-4372-b66c-2c8e5674daa8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:46.455210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:46.490257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a66eb-1b66-4372-b66c-2c8e5674daa8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:46.523502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:46.524140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.524427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.524707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.534607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:46.539540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:46.540814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:46.542065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 559/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:46.548219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47b6c-4bc6-4663-867b-d7127d915f05 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:46.643303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47b6c-4bc6-4663-867b-d7127d915f05 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:46.650510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:46.677234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:46.677878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.678162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.678438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.679413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:46.679717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:46.681232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:46.690352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 583/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:46.696266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:46.795011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c21f-0ba8-4e04-a879-fd5af0cfb07c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:46.824611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:46.829405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:46.830112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.830397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.830678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] PATH_INFO: `/v3/users/b0a50c4b89b04ceab825cd420ebedd99` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.845382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a50c4b89b04ceab825cd420ebedd99)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:46.846875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:46.848562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 560/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:46 2022] GET /identity/v3/users/b0a50c4b89b04ceab825cd420ebedd99 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:46.854436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:46.955355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaac9a4-c08c-49fc-8880-a65755c51896 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:46.990173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:46.990796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.991078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.991349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.026727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:47.060834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:47.062313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:47.163234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 584/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:47.170609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:47.274377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a56b14-e8fd-4e1e-b4d2-406f3545b3c6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:47.310128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad4002-6d87-431e-ba0e-7874b49d4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:47.310774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4002-6d87-431e-ba0e-7874b49d4196 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.311110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4002-6d87-431e-ba0e-7874b49d4196 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.311371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4002-6d87-431e-ba0e-7874b49d4196 None admin] PATH_INFO: `/v3/projects/2339f90a62444819a650708d435bdd80` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.312601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad4002-6d87-431e-ba0e-7874b49d4196 None admin] RBAC: Authorizing `identity:get_project(project_id=2339f90a62444819a650708d435bdd80)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:47.314084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad4002-6d87-431e-ba0e-7874b49d4196 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:47.315766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 561/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:47 2022] GET /identity/v3/projects/2339f90a62444819a650708d435bdd80 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:47.321980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:47.388247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:47.420945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b602a1-ff15-4677-8c9c-55a7fd842155 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:47.456400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ab193-88e5-4b68-8187-33d231b9c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:47.457021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab193-88e5-4b68-8187-33d231b9c145 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:47.457308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab193-88e5-4b68-8187-33d231b9c145 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:47.457620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab193-88e5-4b68-8187-33d231b9c145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:47.458415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ab193-88e5-4b68-8187-33d231b9c145 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=2339f90a62444819a650708d435bdd80, user.id=b0a50c4b89b04ceab825cd420ebedd99) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:47.458729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ab193-88e5-4b68-8187-33d231b9c145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:47.460186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ab193-88e5-4b68-8187-33d231b9c145 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:47.465678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 585/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:47 2022] GET /identity/v3/role_assignments?user.id=b0a50c4b89b04ceab825cd420ebedd99&scope.project.id=2339f90a62444819a650708d435bdd80&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:49.465962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab757b-5a25-484b-b85f-bd708d0cff2c None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.466787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab757b-5a25-484b-b85f-bd708d0cff2c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.466787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab757b-5a25-484b-b85f-bd708d0cff2c None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.467868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 562/1147] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:49.473539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a752-e737-465d-a504-50cb5310b494 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.473992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a752-e737-465d-a504-50cb5310b494 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.474110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a752-e737-465d-a504-50cb5310b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.492690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0a59a752-e737-465d-a504-50cb5310b494 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:49.493951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0a59a752-e737-465d-a504-50cb5310b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:49.558879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 586/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:49.581294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab757b-5a25-484b-b85f-bd708d0cff2c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.639142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:49.680885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab757b-5a25-484b-b85f-bd708d0cff2c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:49.715899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:49.716544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.716830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.717109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.727639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:49.732568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:49.734424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:49.736766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 563/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:49.740560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a752-e737-465d-a504-50cb5310b494 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.802112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:49.842072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a752-e737-465d-a504-50cb5310b494 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:49.875598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:49.876214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.876496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.876770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.877478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:49.877814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:49.879187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:49.887031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 587/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:49.892830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.990937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3d42f-13bc-4995-beb2-25406d172679 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:50.007632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:50.025172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:50.025846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.026134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.026416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] PATH_INFO: `/v3/users/b0a50c4b89b04ceab825cd420ebedd99` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.027587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a50c4b89b04ceab825cd420ebedd99)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:50.029033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:50.031286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 564/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:49 2022] GET /identity/v3/users/b0a50c4b89b04ceab825cd420ebedd99 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:50.037037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:50.134258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e779-79c0-4538-9290-b5c970341e87 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:50.157264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:50.167443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95346a9-34be-4426-a603-725b40905042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:50.168086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95346a9-34be-4426-a603-725b40905042 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.172820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95346a9-34be-4426-a603-725b40905042 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.172820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95346a9-34be-4426-a603-725b40905042 None admin] PATH_INFO: `/v3/projects/2339f90a62444819a650708d435bdd80` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.172820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95346a9-34be-4426-a603-725b40905042 None admin] RBAC: Authorizing `identity:get_project(project_id=2339f90a62444819a650708d435bdd80)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:50.172820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95346a9-34be-4426-a603-725b40905042 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:50.173166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 588/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:50 2022] GET /identity/v3/projects/2339f90a62444819a650708d435bdd80 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:50.179345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:50.276089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79eac4-b4ff-4fc3-9106-dc209c89d381 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:50.311776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26440783-6d6d-419c-99bc-d70fe762aca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:50.312452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26440783-6d6d-419c-99bc-d70fe762aca7 None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:50.312736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26440783-6d6d-419c-99bc-d70fe762aca7 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:50.313015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26440783-6d6d-419c-99bc-d70fe762aca7 None admin] PATH_INFO: `/v3/projects/2339f90a62444819a650708d435bdd80/users/b0a50c4b89b04ceab825cd420ebedd99/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:50.315098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26440783-6d6d-419c-99bc-d70fe762aca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2339f90a62444819a650708d435bdd80, user_id=b0a50c4b89b04ceab825cd420ebedd99, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:50.316546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26440783-6d6d-419c-99bc-d70fe762aca7 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:50.409968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 565/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:37:50 2022] PUT /identity/v3/projects/2339f90a62444819a650708d435bdd80/users/b0a50c4b89b04ceab825cd420ebedd99/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:37:52.374277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f003abb-a029-4063-a9e5-b305c2b91d5b None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.374803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f003abb-a029-4063-a9e5-b305c2b91d5b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.374803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f003abb-a029-4063-a9e5-b305c2b91d5b None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.376202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 589/1154] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:52.381748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dcbe6-4142-427f-b9d9-9b3b127b8a7c None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.382157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dcbe6-4142-427f-b9d9-9b3b127b8a7c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.382300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dcbe6-4142-427f-b9d9-9b3b127b8a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.399934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d87dcbe6-4142-427f-b9d9-9b3b127b8a7c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:52.401135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d87dcbe6-4142-427f-b9d9-9b3b127b8a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:52.442543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:52.466206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 566/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:52.489331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f003abb-a029-4063-a9e5-b305c2b91d5b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:52.594755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f003abb-a029-4063-a9e5-b305c2b91d5b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:52.627282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:52.627920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.628207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.628482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.638781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:37:52.643652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:52.644748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:37:52.645750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 590/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:52.650966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dcbe6-4142-427f-b9d9-9b3b127b8a7c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:52.748420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dcbe6-4142-427f-b9d9-9b3b127b8a7c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:52.780873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:52.781494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.781802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.782077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.782789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:52.783093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:52.784468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:52.792287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 567/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:52.798685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:52.850174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:52.897906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358861-525d-4cf9-b878-6bfba74e23b4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:52.936086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:52.936729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.937008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.937283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] PATH_INFO: `/v3/users/b0a50c4b89b04ceab825cd420ebedd99` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.938490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a50c4b89b04ceab825cd420ebedd99)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:52.940144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:52.941838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 591/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:37:52 2022] GET /identity/v3/users/b0a50c4b89b04ceab825cd420ebedd99 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:52.947897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:52.988590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:53.047569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f086-612f-4d07-b912-86b55a73ba0e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:53.080392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:53.081007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:53.081294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:53.081617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:53.150154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:53.151535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:53.189202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:53.248107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 568/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:53.254124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:53.354106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49672cda-d0dd-47e8-9667-cb64a0a438b4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:53.372720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:53.386690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863278-4b5f-4ed1-883b-2739be2f2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:53.387323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863278-4b5f-4ed1-883b-2739be2f2be6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:53.387604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863278-4b5f-4ed1-883b-2739be2f2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:53.387879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863278-4b5f-4ed1-883b-2739be2f2be6 None admin] PATH_INFO: `/v3/projects/2339f90a62444819a650708d435bdd80` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:53.389671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00863278-4b5f-4ed1-883b-2739be2f2be6 None admin] RBAC: Authorizing `identity:get_project(project_id=2339f90a62444819a650708d435bdd80)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:53.391175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00863278-4b5f-4ed1-883b-2739be2f2be6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:53.392864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 592/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:37:53 2022] GET /identity/v3/projects/2339f90a62444819a650708d435bdd80 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:53.399030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:53.495579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02b409-052d-4c0c-8df0-6f63dda272ec None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:53.529631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68786ef1-667d-425f-8f14-ef4bd5b579c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:53.530242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68786ef1-667d-425f-8f14-ef4bd5b579c3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:53.530522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68786ef1-667d-425f-8f14-ef4bd5b579c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:53.530795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68786ef1-667d-425f-8f14-ef4bd5b579c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:53.531564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68786ef1-667d-425f-8f14-ef4bd5b579c3 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=2339f90a62444819a650708d435bdd80, user.id=b0a50c4b89b04ceab825cd420ebedd99) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:53.531872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68786ef1-667d-425f-8f14-ef4bd5b579c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:53.533291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68786ef1-667d-425f-8f14-ef4bd5b579c3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:53.538908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 569/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:37:53 2022] GET /identity/v3/role_assignments?user.id=b0a50c4b89b04ceab825cd420ebedd99&scope.project.id=2339f90a62444819a650708d435bdd80&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:55.550935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10649f-1e32-42b6-b0a4-ef55bc6548dc None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:55.551474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10649f-1e32-42b6-b0a4-ef55bc6548dc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:55.551474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10649f-1e32-42b6-b0a4-ef55bc6548dc None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:55.552761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 593/1162] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:55.558521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691593dd-c0bf-4c3d-812c-22cc4de8cdc0 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:55.558989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691593dd-c0bf-4c3d-812c-22cc4de8cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:55.559104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691593dd-c0bf-4c3d-812c-22cc4de8cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:55.565444 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:55.578548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-691593dd-c0bf-4c3d-812c-22cc4de8cdc0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:55.579747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-691593dd-c0bf-4c3d-812c-22cc4de8cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:55.659349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 570/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:55.682434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10649f-1e32-42b6-b0a4-ef55bc6548dc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:55.786760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10649f-1e32-42b6-b0a4-ef55bc6548dc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:55.821580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:55.822127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:55.822408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:55.822681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:55.877532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:55.889833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:55.891316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:55.991107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 594/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:37:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:55.997340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691593dd-c0bf-4c3d-812c-22cc4de8cdc0 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:56.106885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691593dd-c0bf-4c3d-812c-22cc4de8cdc0 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:56.138303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:56.143269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b981e-0a65-4329-b407-9c5b037cb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:56.143918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b981e-0a65-4329-b407-9c5b037cb063 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:56.144198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b981e-0a65-4329-b407-9c5b037cb063 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:56.144473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b981e-0a65-4329-b407-9c5b037cb063 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:56.152202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b981e-0a65-4329-b407-9c5b037cb063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:56.153706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b981e-0a65-4329-b407-9c5b037cb063 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-b44b981e-0a65-4329-b407-9c5b037cb063 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:37:56.165431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:37:56.166731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:37:56.167770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 571/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:37:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:37:56.174305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:56.260835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:56.272369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5f7d-4b9d-47d9-ae54-fcf5f75b79b1 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:56.307540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fa56a-0036-4d6c-b80b-c64f505ade46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:56.308151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fa56a-0036-4d6c-b80b-c64f505ade46 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:56.308440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fa56a-0036-4d6c-b80b-c64f505ade46 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:56.308923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fa56a-0036-4d6c-b80b-c64f505ade46 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:56.309948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fa56a-0036-4d6c-b80b-c64f505ade46 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:37:56.311285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fa56a-0036-4d6c-b80b-c64f505ade46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:56.312693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fa56a-0036-4d6c-b80b-c64f505ade46 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:56.320016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 595/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 1 15:37:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:37:58.330432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe307-61c8-450a-a794-5048f5b9b905 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:58.331023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe307-61c8-450a-a794-5048f5b9b905 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:58.331023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe307-61c8-450a-a794-5048f5b9b905 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:58.332354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 572/1167] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:37:58.337503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6de19-7556-4033-834e-c7e835a6c35c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:58.338096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6de19-7556-4033-834e-c7e835a6c35c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:58.338096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6de19-7556-4033-834e-c7e835a6c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:58.357039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-f7b6de19-7556-4033-834e-c7e835a6c35c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:58.358639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f7b6de19-7556-4033-834e-c7e835a6c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:58.445150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 596/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:37:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:37:58.468788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abe307-61c8-450a-a794-5048f5b9b905 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:58.580992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abe307-61c8-450a-a794-5048f5b9b905 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:58.620812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f805c-0d3c-4ee2-991e-fd3a8e2f3cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:58.621431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f805c-0d3c-4ee2-991e-fd3a8e2f3cd6 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:58.621825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f805c-0d3c-4ee2-991e-fd3a8e2f3cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:58.622103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f805c-0d3c-4ee2-991e-fd3a8e2f3cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:58.623299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f805c-0d3c-4ee2-991e-fd3a8e2f3cd6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:58.624679 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f805c-0d3c-4ee2-991e-fd3a8e2f3cd6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:58.728299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 573/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Mon Aug 1 15:37:58 2022] POST /identity/v3/domains => generated 267 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:00.818334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64cdd9-7471-48c6-b398-aed8a9fa1683 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:00.818871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64cdd9-7471-48c6-b398-aed8a9fa1683 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:00.818961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64cdd9-7471-48c6-b398-aed8a9fa1683 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:00.820265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 597/1170] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:00.825489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db59965-2f10-45e3-932a-cf5d41a53367 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:00.825898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db59965-2f10-45e3-932a-cf5d41a53367 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:00.826140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db59965-2f10-45e3-932a-cf5d41a53367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:00.846530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0db59965-2f10-45e3-932a-cf5d41a53367 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:00.848077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0db59965-2f10-45e3-932a-cf5d41a53367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:00.896085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:00.915544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 574/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:38:00.938677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64cdd9-7471-48c6-b398-aed8a9fa1683 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:01.020605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:01.039331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64cdd9-7471-48c6-b398-aed8a9fa1683 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:01.073408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f7d63-5230-4901-839e-863d902e95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:01.073987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7d63-5230-4901-839e-863d902e95a1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:01.074266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7d63-5230-4901-839e-863d902e95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:01.074540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7d63-5230-4901-839e-863d902e95a1 None admin] PATH_INFO: `/v3/domains/a3396ea0df274c3a9924b65b15af771e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:01.084606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f7d63-5230-4901-839e-863d902e95a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3396ea0df274c3a9924b65b15af771e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:01.086090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f7d63-5230-4901-839e-863d902e95a1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:01.087787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 598/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Mon Aug 1 15:38:00 2022] GET /identity/v3/domains/a3396ea0df274c3a9924b65b15af771e => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:01.094387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db59965-2f10-45e3-932a-cf5d41a53367 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:01.191106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db59965-2f10-45e3-932a-cf5d41a53367 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:01.225752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4335313-cc9c-4ece-a88a-05131a5aa4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:01.226376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335313-cc9c-4ece-a88a-05131a5aa4a1 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:01.226660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335313-cc9c-4ece-a88a-05131a5aa4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:01.226939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335313-cc9c-4ece-a88a-05131a5aa4a1 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:01.227635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4335313-cc9c-4ece-a88a-05131a5aa4a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:01.229103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4335313-cc9c-4ece-a88a-05131a5aa4a1 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:01.311457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 575/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:38:01 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:03.385208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657507-51bf-4e1e-b93f-c83311918461 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:03.385790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657507-51bf-4e1e-b93f-c83311918461 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:03.385889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657507-51bf-4e1e-b93f-c83311918461 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:03.387222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 599/1174] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:03.392905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c408af-2bbb-4dac-82ed-49f5b53f6fdc None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:03.393343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c408af-2bbb-4dac-82ed-49f5b53f6fdc None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:03.393443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c408af-2bbb-4dac-82ed-49f5b53f6fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:03.411069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-22c408af-2bbb-4dac-82ed-49f5b53f6fdc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:03.412273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-22c408af-2bbb-4dac-82ed-49f5b53f6fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:03.438384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:03.478436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 576/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:38:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:38:03.504130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657507-51bf-4e1e-b93f-c83311918461 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:03.607558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657507-51bf-4e1e-b93f-c83311918461 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:03.641934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd63e82-3943-4d72-9e74-0a2874cbf466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:03.642593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd63e82-3943-4d72-9e74-0a2874cbf466 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:03.642895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd63e82-3943-4d72-9e74-0a2874cbf466 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:03.643189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd63e82-3943-4d72-9e74-0a2874cbf466 None admin] PATH_INFO: `/v3/domains/a3396ea0df274c3a9924b65b15af771e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:03.644370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd63e82-3943-4d72-9e74-0a2874cbf466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3396ea0df274c3a9924b65b15af771e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:03.645988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd63e82-3943-4d72-9e74-0a2874cbf466 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:03.647623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 600/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Mon Aug 1 15:38:03 2022] GET /identity/v3/domains/a3396ea0df274c3a9924b65b15af771e => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:38:03.654026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c408af-2bbb-4dac-82ed-49f5b53f6fdc None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:03.756031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c408af-2bbb-4dac-82ed-49f5b53f6fdc None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:03.789131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1b647-24e5-47a3-a4f2-e88dcab08753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:03.789776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b647-24e5-47a3-a4f2-e88dcab08753 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:03.790058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b647-24e5-47a3-a4f2-e88dcab08753 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:03.790331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b647-24e5-47a3-a4f2-e88dcab08753 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:03.791144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1b647-24e5-47a3-a4f2-e88dcab08753 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:03.792577 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1b647-24e5-47a3-a4f2-e88dcab08753 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:03.912417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 577/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:38:03 2022] POST /identity/v3/users => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:38:05.948851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c2316-ec81-4582-ad5a-17aaeaaef77d None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.949410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c2316-ec81-4582-ad5a-17aaeaaef77d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.949410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c2316-ec81-4582-ad5a-17aaeaaef77d None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.951383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 601/1178] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:05.956490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a4f6f-b4c6-480d-ad02-f0b453d71ec8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.956895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a4f6f-b4c6-480d-ad02-f0b453d71ec8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.957051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a4f6f-b4c6-480d-ad02-f0b453d71ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.976142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d73a4f6f-b4c6-480d-ad02-f0b453d71ec8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:05.977314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d73a4f6f-b4c6-480d-ad02-f0b453d71ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.990933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:06.049256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 578/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:38:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:38:06.072186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c2316-ec81-4582-ad5a-17aaeaaef77d None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:06.085468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:06.173539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c2316-ec81-4582-ad5a-17aaeaaef77d None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:06.209429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:06.210019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:06.210306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:06.210586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:06.221274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:38:06.226184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:38:06.227346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:38:06.228700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 602/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:38:06.233710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a4f6f-b4c6-480d-ad02-f0b453d71ec8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:06.333910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a4f6f-b4c6-480d-ad02-f0b453d71ec8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:06.367214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:06.367842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:06.368125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:06.368402 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:06.369115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:06.369424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:06.370837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:06.379440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 579/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:06.385362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:06.454706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:06.487689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a26e2-bff3-4825-b034-77d7de196e59 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:06.521718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:06.522360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:06.522647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:06.522929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] PATH_INFO: `/v3/users/8a2596c3297646cd8bf119c3b119622b` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:06.535829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] RBAC: Authorizing `identity:get_user(user_id=8a2596c3297646cd8bf119c3b119622b)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:06.537260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:06.538938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 603/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:38:06 2022] GET /identity/v3/users/8a2596c3297646cd8bf119c3b119622b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:06.545542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:06.561274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:06.720603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09f5dc-904e-4e9a-9741-455522acc65d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:06.755348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:06.755983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:06.756271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:06.756551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:06.822527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:06.823992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:06.837234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:06.920256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 580/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:38:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:38:06.926486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:07.028954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1bdbb-5e75-43e4-ab7b-f2edb8ea5e14 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:07.055723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:07.063365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba0665-4218-47fb-8295-a8cebe88e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:07.064004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0665-4218-47fb-8295-a8cebe88e956 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.067681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0665-4218-47fb-8295-a8cebe88e956 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.067681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0665-4218-47fb-8295-a8cebe88e956 None admin] PATH_INFO: `/v3/projects/27c0b471ef28490bac2ea56582c9435c` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.067681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba0665-4218-47fb-8295-a8cebe88e956 None admin] RBAC: Authorizing `identity:get_project(project_id=27c0b471ef28490bac2ea56582c9435c)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:07.067681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba0665-4218-47fb-8295-a8cebe88e956 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:07.068815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 604/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:38:06 2022] GET /identity/v3/projects/27c0b471ef28490bac2ea56582c9435c => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:07.074963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:07.177573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3c83e-92ba-43da-9370-065d178ba8af None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:07.190887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:07.212267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ada64-26ce-46e8-b38e-ce4eb8356de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:07.212888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ada64-26ce-46e8-b38e-ce4eb8356de5 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.213177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ada64-26ce-46e8-b38e-ce4eb8356de5 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.213454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ada64-26ce-46e8-b38e-ce4eb8356de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.214274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ada64-26ce-46e8-b38e-ce4eb8356de5 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=27c0b471ef28490bac2ea56582c9435c, user.id=8a2596c3297646cd8bf119c3b119622b) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:07.214588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ada64-26ce-46e8-b38e-ce4eb8356de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:07.216647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ada64-26ce-46e8-b38e-ce4eb8356de5 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:07.222169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 581/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:38:07 2022] GET /identity/v3/role_assignments?user.id=8a2596c3297646cd8bf119c3b119622b&scope.project.id=27c0b471ef28490bac2ea56582c9435c&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:09.203623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8e7c-fc78-4c69-9a38-6fcac26cac69 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.204201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8e7c-fc78-4c69-9a38-6fcac26cac69 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.204201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8e7c-fc78-4c69-9a38-6fcac26cac69 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.205535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 605/1186] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:09.210980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d2ac-a322-4035-9283-9f4a58fcf757 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.211742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d2ac-a322-4035-9283-9f4a58fcf757 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.211742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d2ac-a322-4035-9283-9f4a58fcf757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.230088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f143d2ac-a322-4035-9283-9f4a58fcf757 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:09.231296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f143d2ac-a322-4035-9283-9f4a58fcf757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:09.305427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 582/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:38:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:38:09.328609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8e7c-fc78-4c69-9a38-6fcac26cac69 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.426897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8e7c-fc78-4c69-9a38-6fcac26cac69 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.463111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:09.463659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.463945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.464222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.474203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:38:09.479040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:38:09.480721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:38:09.482979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 606/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:38:09.486731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143d2ac-a322-4035-9283-9f4a58fcf757 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.585821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143d2ac-a322-4035-9283-9f4a58fcf757 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.594086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:09.620383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:09.621006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.621285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.621621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.622942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:09.623244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:09.624616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:09.633245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 583/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:09.639657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.695357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:09.738357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea70c3f-7de4-45cb-bb88-afb30a9f9218 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.771046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:09.771686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.771972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.772251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] PATH_INFO: `/v3/users/8a2596c3297646cd8bf119c3b119622b` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.773424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=8a2596c3297646cd8bf119c3b119622b)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:09.774896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:09.776511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 607/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:38:09 2022] GET /identity/v3/users/8a2596c3297646cd8bf119c3b119622b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:09.782412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:09.881708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd1542-d172-4807-b4cf-eb72185148fd None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:09.914637 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37113201-f9c8-4ec0-86ef-a581825ffb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:09.915278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113201-f9c8-4ec0-86ef-a581825ffb6b None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:09.915562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113201-f9c8-4ec0-86ef-a581825ffb6b None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:09.915838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113201-f9c8-4ec0-86ef-a581825ffb6b None admin] PATH_INFO: `/v3/projects/27c0b471ef28490bac2ea56582c9435c` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:09.916998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37113201-f9c8-4ec0-86ef-a581825ffb6b None admin] RBAC: Authorizing `identity:get_project(project_id=27c0b471ef28490bac2ea56582c9435c)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:09.918464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37113201-f9c8-4ec0-86ef-a581825ffb6b None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:09.920775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 584/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:38:09 2022] GET /identity/v3/projects/27c0b471ef28490bac2ea56582c9435c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:09.926709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.026179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622140c-edbb-4405-97f7-92461e18a3e9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.049864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:10.060362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d7254-9cb6-4942-acbc-87673f7af3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.061034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d7254-9cb6-4942-acbc-87673f7af3ca None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.061314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d7254-9cb6-4942-acbc-87673f7af3ca None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.061618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d7254-9cb6-4942-acbc-87673f7af3ca None admin] PATH_INFO: `/v3/projects/27c0b471ef28490bac2ea56582c9435c/users/8a2596c3297646cd8bf119c3b119622b/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.063567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d7254-9cb6-4942-acbc-87673f7af3ca None admin] RBAC: Authorizing `identity:create_grant(project_id=27c0b471ef28490bac2ea56582c9435c, user_id=8a2596c3297646cd8bf119c3b119622b, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.065026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d7254-9cb6-4942-acbc-87673f7af3ca None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.174506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 608/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:38:09 2022] PUT /identity/v3/projects/27c0b471ef28490bac2ea56582c9435c/users/8a2596c3297646cd8bf119c3b119622b/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:38:12.172491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf16ac4-0102-4a7c-9304-3c3ada181919 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.173059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf16ac4-0102-4a7c-9304-3c3ada181919 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.173059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf16ac4-0102-4a7c-9304-3c3ada181919 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.174446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 585/1193] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:38:12.180200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55778b-c888-4fca-868b-a64114ee9f36 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.180604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55778b-c888-4fca-868b-a64114ee9f36 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.180752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55778b-c888-4fca-868b-a64114ee9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.200852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-db55778b-c888-4fca-868b-a64114ee9f36 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:12.202060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-db55778b-c888-4fca-868b-a64114ee9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:12.267057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 609/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:38:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:38:12.289942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf16ac4-0102-4a7c-9304-3c3ada181919 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:12.326910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:12.391604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf16ac4-0102-4a7c-9304-3c3ada181919 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:12.423929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:12.424498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.424784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.425055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.436233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:38:12.441086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:38:12.442122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:38:12.442977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 586/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:38:12.449173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55778b-c888-4fca-868b-a64114ee9f36 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:12.549945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55778b-c888-4fca-868b-a64114ee9f36 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:12.565153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:12.585241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:12.585886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.586171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.586448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.587162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:12.587466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:12.588840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:12.597163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 610/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:12.602752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:12.707557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:12.713128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad917cd-d806-40c5-8d96-1d244dc99df0 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:12.749701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:12.750351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.750634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.750915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] PATH_INFO: `/v3/users/8a2596c3297646cd8bf119c3b119622b` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.752087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] RBAC: Authorizing `identity:get_user(user_id=8a2596c3297646cd8bf119c3b119622b)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:12.753566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:12.755194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 587/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 1 15:38:12 2022] GET /identity/v3/users/8a2596c3297646cd8bf119c3b119622b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:12.761136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:12.860019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cc2e2-ba19-43dc-a2e0-7b322080aad6 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:12.895541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:12.896170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:12.896456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:12.896735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:12.942314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:12.964543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:12.966048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:13.064273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 611/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:38:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:38:13.070357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:13.183428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2265-8a0d-469a-a322-882249b9f037 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:13.223591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218a271-b9c1-42f3-bc3c-ce988d1fa427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:13.224151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a271-b9c1-42f3-bc3c-ce988d1fa427 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:13.224432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a271-b9c1-42f3-bc3c-ce988d1fa427 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:13.224708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a271-b9c1-42f3-bc3c-ce988d1fa427 None admin] PATH_INFO: `/v3/projects/27c0b471ef28490bac2ea56582c9435c` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:13.225918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218a271-b9c1-42f3-bc3c-ce988d1fa427 None admin] RBAC: Authorizing `identity:get_project(project_id=27c0b471ef28490bac2ea56582c9435c)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:13.227549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218a271-b9c1-42f3-bc3c-ce988d1fa427 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:13.229216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 588/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 1 15:38:13 2022] GET /identity/v3/projects/27c0b471ef28490bac2ea56582c9435c => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:13.236148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:13.313605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:13.335285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7f86f-140b-4e25-a998-cf7a21594a48 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:13.368968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110bcdc-2315-4670-8bf6-c0c692a9f3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:13.369617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110bcdc-2315-4670-8bf6-c0c692a9f3a1 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:13.369903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110bcdc-2315-4670-8bf6-c0c692a9f3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:13.370179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110bcdc-2315-4670-8bf6-c0c692a9f3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:13.370968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110bcdc-2315-4670-8bf6-c0c692a9f3a1 None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=27c0b471ef28490bac2ea56582c9435c, user.id=8a2596c3297646cd8bf119c3b119622b) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:38:13.371280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110bcdc-2315-4670-8bf6-c0c692a9f3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:13.373274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110bcdc-2315-4670-8bf6-c0c692a9f3a1 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:13.379308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 612/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:38:13 2022] GET /identity/v3/role_assignments?user.id=8a2596c3297646cd8bf119c3b119622b&scope.project.id=27c0b471ef28490bac2ea56582c9435c&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:38:23.219146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=84 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:23.376432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=30 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:39.986941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b770-50f7-4daf-bc65-8bd38ce75282 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:39.987560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b770-50f7-4daf-bc65-8bd38ce75282 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:39.987701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b770-50f7-4daf-bc65-8bd38ce75282 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:39.989099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 589/1201] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:39:39.994794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66977d7f-cafa-40b3-87fc-04fbee8d6482 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:39.995313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66977d7f-cafa-40b3-87fc-04fbee8d6482 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:39.995414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66977d7f-cafa-40b3-87fc-04fbee8d6482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:40.014938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-66977d7f-cafa-40b3-87fc-04fbee8d6482 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:40.016983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-66977d7f-cafa-40b3-87fc-04fbee8d6482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:40.112792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 613/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:39:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:39:40.137313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b770-50f7-4daf-bc65-8bd38ce75282 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:40.255669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b770-50f7-4daf-bc65-8bd38ce75282 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:40.312566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:40.313422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:40.313787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:40.314109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:40.326865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:40.328354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:40.343117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:40.349410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:40.351701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:40.351701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:40.351701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:40.351701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:40.351701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 590/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:40.352870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66977d7f-cafa-40b3-87fc-04fbee8d6482 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:40.463216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66977d7f-cafa-40b3-87fc-04fbee8d6482 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:40.492783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:40.498948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60188769-6c84-4c6a-9471-8fe2190bef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:40.499631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188769-6c84-4c6a-9471-8fe2190bef39 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:40.499941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188769-6c84-4c6a-9471-8fe2190bef39 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:40.500271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188769-6c84-4c6a-9471-8fe2190bef39 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:40.501133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60188769-6c84-4c6a-9471-8fe2190bef39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:40.501569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60188769-6c84-4c6a-9471-8fe2190bef39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:40.504185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60188769-6c84-4c6a-9471-8fe2190bef39 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:40.518541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 614/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:40.525276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:40.590417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:40.650762 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399ac4-45b9-4363-b7c9-511c3ca0149a None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:40.703756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc21c0-1d71-41c4-b04e-88ceb3bbcba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:40.704967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc21c0-1d71-41c4-b04e-88ceb3bbcba4 None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:40.705448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc21c0-1d71-41c4-b04e-88ceb3bbcba4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:40.710333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc21c0-1d71-41c4-b04e-88ceb3bbcba4 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:40.710333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc21c0-1d71-41c4-b04e-88ceb3bbcba4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:40.710333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc21c0-1d71-41c4-b04e-88ceb3bbcba4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:40.960107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 591/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 1 15:39:40 2022] POST /identity/v3/users => generated 251 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:39:43.249632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6acd35-4087-4b6e-9985-e64a6bb096d4 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.250525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6acd35-4087-4b6e-9985-e64a6bb096d4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.250525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6acd35-4087-4b6e-9985-e64a6bb096d4 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.251715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 615/1206] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:39:43.258270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b257e-a84f-4557-84d2-4d879b750733 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.259110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b257e-a84f-4557-84d2-4d879b750733 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.259110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b257e-a84f-4557-84d2-4d879b750733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.284120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-996b257e-a84f-4557-84d2-4d879b750733 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:43.286003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-996b257e-a84f-4557-84d2-4d879b750733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:43.391550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 592/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:39:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:39:43.420461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6acd35-4087-4b6e-9985-e64a6bb096d4 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:43.590440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6acd35-4087-4b6e-9985-e64a6bb096d4 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:43.639378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:43.640254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.640693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.641163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.658744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:39:43.664745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:43.673659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:43.674993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 616/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:43.676374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b257e-a84f-4557-84d2-4d879b750733 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:43.718748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:43.782796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b257e-a84f-4557-84d2-4d879b750733 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:43.819913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:43.821150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:43.821440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:43.821749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:43.826513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:43.826513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:43.826513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:43.833608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 593/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:43.840341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:43.908709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:43.972490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d3e7a-8bca-4090-9581-9144fbd5a06d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:44.016070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:44.016721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:44.017005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:44.017277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:44.029383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:44.030856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:44.046210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:44.047984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:44.049223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:44.049223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:44.049223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:44.049223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:44.049223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 617/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:39:44.054660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:44.196426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6b07-f4b1-441c-a9e0-776ce2bfb2c6 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:44.233615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:44.234324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:44.234651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:44.234981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:44.235764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:44.236117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:44.237578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:44.253215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 594/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:44.260179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:44.409505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37e17-cd94-400a-a6f3-79ec3dd4325d None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:44.412220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:44.470140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:44.470803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:44.471138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:44.471451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:44.480954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:44.482547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:39:44.499371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:44.501339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:44.503443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 618/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:44.511087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:44.658880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7f5e6-4187-44ba-8ed6-022a706ba5b9 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:44.696038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:44.709806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:44.710532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:44.710894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:44.711219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:44.712073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:44.712465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:44.714059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:44.740078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 595/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 1 15:39:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:44.749900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:44.880376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c4190-6b81-4237-9808-6afad87d8409 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:44.930280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:44.931124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:44.931466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:44.931798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:44.978582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:45.030117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:45.031600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:45.149543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 619/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:39:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:45.158750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:45.188767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:45.284856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868cccf-ae34-4e89-bf85-4156e830f589 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:45.340177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:45.341230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:45.341759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:45.342243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:45.360584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:45.363468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:45.380539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:45.382574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:45.384286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:45.384286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:45.384286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:45.384286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:45.385736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 596/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:45.388084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:45.460835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:45.507164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc306-426a-4951-8e18-489ba84c95ed None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:45.550578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:45.551080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:45.551369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:45.551644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:45.552612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:45.552915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:45.554429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:45.566717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 620/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:45.575757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:45.685649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:45.728008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3854-70a9-4077-8e03-81a8d2eafe66 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:45.777582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:45.778617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:45.779110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:45.779609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:45.792430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:45.795149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:39:45.811903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:45.813944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:45.815981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 597/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:39:45.819196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:45.963787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72abe-a8df-4fc6-8bfa-7cb9c1d11a66 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:45.989073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:46.010115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31388de9-2a88-4879-a904-8f7840f0df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:46.010806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388de9-2a88-4879-a904-8f7840f0df2b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:46.011141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388de9-2a88-4879-a904-8f7840f0df2b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:46.011459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388de9-2a88-4879-a904-8f7840f0df2b None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:46.012276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388de9-2a88-4879-a904-8f7840f0df2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:46.012619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388de9-2a88-4879-a904-8f7840f0df2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:46.014446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388de9-2a88-4879-a904-8f7840f0df2b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:46.034169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 621/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:46.044148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:46.197639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450ed97-c765-46ad-87b2-a279ddf3df61 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:46.229730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:46.236609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcf67a-9db1-4240-9bd8-a178e4aad551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:46.237177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcf67a-9db1-4240-9bd8-a178e4aad551 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:46.237576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcf67a-9db1-4240-9bd8-a178e4aad551 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:46.238049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcf67a-9db1-4240-9bd8-a178e4aad551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:46.238832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcf67a-9db1-4240-9bd8-a178e4aad551 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=7d1d3e9e0b7042978e47d3912df36daf) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:46.239220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcf67a-9db1-4240-9bd8-a178e4aad551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:46.240957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcf67a-9db1-4240-9bd8-a178e4aad551 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:46.247966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 598/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:39:46 2022] GET /identity/v3/role_assignments?user.id=7d1d3e9e0b7042978e47d3912df36daf&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:48.337949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0234f-eb6b-4cd2-bcba-db0c54130b42 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.338502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0234f-eb6b-4cd2-bcba-db0c54130b42 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.338502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0234f-eb6b-4cd2-bcba-db0c54130b42 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.339946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 622/1220] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:39:48.346180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbcb8d-60b1-4f8a-b847-a1065f0ee681 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.346709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbcb8d-60b1-4f8a-b847-a1065f0ee681 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.347205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbcb8d-60b1-4f8a-b847-a1065f0ee681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.371255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-68cbcb8d-60b1-4f8a-b847-a1065f0ee681 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:48.372573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-68cbcb8d-60b1-4f8a-b847-a1065f0ee681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:48.442373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 599/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:39:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:39:48.465093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0234f-eb6b-4cd2-bcba-db0c54130b42 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.575624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0234f-eb6b-4cd2-bcba-db0c54130b42 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.610563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.611935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.611935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.611935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.622833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:39:48.629138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:48.630302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:48.631371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 623/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:48.640009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbcb8d-60b1-4f8a-b847-a1065f0ee681 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.743145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbcb8d-60b1-4f8a-b847-a1065f0ee681 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.768558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:48.779469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.780103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.780388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.780699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.781419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] RBAC: Adding query filter params (name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:48.781774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.783187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.792450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 600/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:39:48.801000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:48.853555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:48.910718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244188e-7cbf-4572-a0cf-d802fc3654d7 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:48.947078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:48.947718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:48.948004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:48.948283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:48.959895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:48.962090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:48.977476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:48.979190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:48.980685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:48.980685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:48.980685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:48.980685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:48.980685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 624/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:48.987120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:49.096172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0063d-8238-4779-90f3-f65f454fd24c None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:49.135987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:49.136558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:49.136926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:49.137113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:49.137851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:49.138170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:49.139561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:49.153165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 601/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:49.159734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:49.270468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:49.280326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3b397-345c-4114-8ca6-fee49c17ee39 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:49.327087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:49.327762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:49.328055 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:49.328331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:49.337205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:49.338698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:39:49.350851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:49.352052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:49.353144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 625/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:49.358966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:49.435730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:49.512556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a773bb4-be53-49f8-a240-03e0659595ee None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:49.563061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:49.563890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:49.564266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:49.564685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:49.566148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:49.566598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:49.569001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:49.601958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 602/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 1 15:39:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:49.608044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:49.744627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57413d-c114-4b15-832f-d57c0de1e479 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:49.798102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:49.799226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:49.799698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:49.800140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:49.818344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:49.819876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:49.837648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:49.839278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:49.840195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:49.840195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:49.840195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:49.840195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:49.840195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 626/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:49.849004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:50.015539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca9a2-7f6f-470f-b992-5c595a42a617 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:50.018308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:50.060277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:50.061167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:50.061592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:50.062050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:50.063224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:50.063750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:50.065255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:50.081102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 603/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:50.089578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:50.099925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:50.210780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55278c01-a365-4d52-9630-4f11b33fa833 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:50.267229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:50.267794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:50.268083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:50.268359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:50.277416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:50.279153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:39:50.294818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:50.296253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:50.298071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 627/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:50.309196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:50.448999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184040cd-44b7-4811-b75c-3d54b8993d06 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:50.491147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6fee6-2aed-4b72-b1e0-1b6b5f56e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:50.491798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6fee6-2aed-4b72-b1e0-1b6b5f56e249 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:50.492089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6fee6-2aed-4b72-b1e0-1b6b5f56e249 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:50.492896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6fee6-2aed-4b72-b1e0-1b6b5f56e249 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:50.493719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6fee6-2aed-4b72-b1e0-1b6b5f56e249 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:50.494037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6fee6-2aed-4b72-b1e0-1b6b5f56e249 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:50.495531 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6fee6-2aed-4b72-b1e0-1b6b5f56e249 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:50.510160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 604/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:50.517221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:50.598005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:50.644786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ad304-75e0-4fc1-bd91-66569f910493 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:50.686367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c184c0-a0d2-45f1-a422-8efab30855da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:50.687054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c184c0-a0d2-45f1-a422-8efab30855da None admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:50.687333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c184c0-a0d2-45f1-a422-8efab30855da None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:50.687610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c184c0-a0d2-45f1-a422-8efab30855da None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/7d1d3e9e0b7042978e47d3912df36daf/roles/29678fc410464c378e9689814592e7b2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:50.707662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c184c0-a0d2-45f1-a422-8efab30855da None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=7d1d3e9e0b7042978e47d3912df36daf, role_id=29678fc410464c378e9689814592e7b2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:50.710535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c184c0-a0d2-45f1-a422-8efab30855da None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:50.886711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 628/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:39:50 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/7d1d3e9e0b7042978e47d3912df36daf/roles/29678fc410464c378e9689814592e7b2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:39:53.038463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037000-e6ab-4361-9eb5-c998cb330841 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:53.039044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037000-e6ab-4361-9eb5-c998cb330841 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:53.039044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037000-e6ab-4361-9eb5-c998cb330841 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:53.040582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 605/1233] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:39:53.046118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea87ed-bfa8-497f-8388-5b8685d954b1 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:53.046547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea87ed-bfa8-497f-8388-5b8685d954b1 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:53.046668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea87ed-bfa8-497f-8388-5b8685d954b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:53.065702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-32ea87ed-bfa8-497f-8388-5b8685d954b1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:53.066893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-32ea87ed-bfa8-497f-8388-5b8685d954b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:53.138323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 629/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:39:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:39:53.170468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037000-e6ab-4361-9eb5-c998cb330841 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:53.198962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:53.281010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037000-e6ab-4361-9eb5-c998cb330841 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:53.315230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:53.315872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:53.316157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:53.316433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:53.327039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:39:53.331975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:53.333900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:53.335833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 606/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 1 15:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:53.341965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea87ed-bfa8-497f-8388-5b8685d954b1 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:53.387999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:53.450912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea87ed-bfa8-497f-8388-5b8685d954b1 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:53.490531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:53.491152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:53.491434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:53.491773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:53.493088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] RBAC: Adding query filter params (name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:53.493391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:53.494830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:53.503722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 630/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 1 15:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:53.510845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:53.607054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:53.624976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b74924-2499-4a9a-8da4-f4092ac659ad None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:53.666406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:53.667054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:53.667339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:53.667620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:53.678783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:53.680749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:53.694773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:53.696318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:53.697284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:53.697284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:53.697284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:53.697284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:53.697284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 607/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:53.703007 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:53.806271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c3ab-21fe-4bbf-a722-7fcab4938730 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:53.817417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:53.850660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:53.851289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:53.851568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:53.852351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:53.853048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:53.853349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:53.854763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:53.876610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 631/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:53.876830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:53.982034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f681-6b55-493d-bce0-125460b03a55 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:54.016740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:54.017380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.017698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.018019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.020860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:54.026627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:54.028100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:39:54.040878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:54.043456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:54.045456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 608/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:54.048881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:54.160889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fdba6-af6e-470f-9e6d-074c604f7921 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:54.197977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:54.198603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.198883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.199156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.199943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:54.200248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:54.201731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:54.222243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 632/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 1 15:39:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:54.228411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:54.339206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db107-7f26-4990-88c6-cf2d16b12e67 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:54.379463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:54.380101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.380386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.380664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.447662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:54.454480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:54.456079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:54.568311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 609/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:39:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:54.575301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:54.620001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:54.706363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53148-7202-472a-a7bd-f47bd9ae23fb None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:54.745308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:54.746148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.746633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.746924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.760020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:54.761501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:54.778484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:54.780427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:54.782179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:54.782179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:54.782179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:54.782179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:54.782179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 633/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:54.788122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:54.900170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:54.906596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc4f7d-4997-4e79-93d8-b7ac36bd096e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:54.942582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:54.943207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:54.943486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:54.943759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:54.944468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:54.944774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:54.946789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:54.958796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 610/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:54.964846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:55.053552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:55.078764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd726cd-9819-4afc-997b-d3477f91ec76 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:55.113930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:55.114575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:55.114860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:55.115136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:55.122614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:55.124065 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:39:55.139547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:55.141017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:55.142618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 634/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:55.151102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:55.271157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ca84f-7cbf-42f5-96d0-bc2df24dc993 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:55.319138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db35fc-e445-4542-8bd6-47f04fdd5fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:55.319778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db35fc-e445-4542-8bd6-47f04fdd5fa4 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:55.320061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db35fc-e445-4542-8bd6-47f04fdd5fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:55.320338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db35fc-e445-4542-8bd6-47f04fdd5fa4 None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:55.321139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db35fc-e445-4542-8bd6-47f04fdd5fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:55.321450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db35fc-e445-4542-8bd6-47f04fdd5fa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:55.323146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db35fc-e445-4542-8bd6-47f04fdd5fa4 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:55.341259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 611/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:55.347834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:55.457414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de632-55e1-4b21-8c86-9f74ea397384 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:55.494067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0f789-87de-44cf-ac6c-c2674aaefa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:55.494688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f789-87de-44cf-ac6c-c2674aaefa20 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:55.494970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f789-87de-44cf-ac6c-c2674aaefa20 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:55.495265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f789-87de-44cf-ac6c-c2674aaefa20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:55.496728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f789-87de-44cf-ac6c-c2674aaefa20 None admin] RBAC: Adding query filter params (role.id=29678fc410464c378e9689814592e7b2, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=7d1d3e9e0b7042978e47d3912df36daf) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:55.497280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f789-87de-44cf-ac6c-c2674aaefa20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:55.499554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f789-87de-44cf-ac6c-c2674aaefa20 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:55.506121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 635/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:39:55 2022] GET /identity/v3/role_assignments?user.id=7d1d3e9e0b7042978e47d3912df36daf&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=29678fc410464c378e9689814592e7b2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:39:57.682117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a19a1e-f5ca-4106-917a-a5c2caf10b49 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:57.682976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a19a1e-f5ca-4106-917a-a5c2caf10b49 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:57.682976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a19a1e-f5ca-4106-917a-a5c2caf10b49 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:57.684040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 612/1247] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:39:57.690112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcbf64-ae59-4827-8305-caabf8c4da7e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:57.690684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcbf64-ae59-4827-8305-caabf8c4da7e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:57.690843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcbf64-ae59-4827-8305-caabf8c4da7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:57.698795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:57.712865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-11dcbf64-ae59-4827-8305-caabf8c4da7e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:39:57.714801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-11dcbf64-ae59-4827-8305-caabf8c4da7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:39:57.817377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 636/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:39:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:39:57.842524 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a19a1e-f5ca-4106-917a-a5c2caf10b49 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:57.864900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:58.004315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a19a1e-f5ca-4106-917a-a5c2caf10b49 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:58.051151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:58.051889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:58.052214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:58.052571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:58.066570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:39:58.072177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:58.074010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:58.075663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 613/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:58.079700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcbf64-ae59-4827-8305-caabf8c4da7e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:58.191257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcbf64-ae59-4827-8305-caabf8c4da7e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:58.224357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:58.230559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:58.231215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:58.231544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:58.231869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:58.232652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:58.233010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:58.234604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:58.244521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 637/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:58.250718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:58.353188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:58.384920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cdf0f-39cd-428a-ad2a-89201ee5cc09 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:58.426889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:58.427573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:58.427861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:58.428392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:58.440093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:58.441657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:58.459261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:58.465099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:58.467302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:58.467302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:58.467302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:58.467302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:58.467302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 614/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:58.467852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:58.576757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bf14-b799-404b-993c-499ab1ee78f4 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:58.620866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:58.623761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:58.623761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:58.623761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:58.623761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:58.623761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:58.624576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:58.639446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 638/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:39:58.645500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:58.757271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d398a-d1ed-4e37-9a08-e0129af03d84 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:58.785273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:58.794616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:58.795263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:58.795542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:58.795818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:58.804252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:58.806388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:39:58.819268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:58.822162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:39:58.824422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:39:58.825705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 615/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:58.827227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:58.893476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:58.941844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4ad50-1d9e-4cf6-b132-6762138f36b9 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:58.978156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:58.978786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:58.979078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:58.979360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:58.980212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:58.980531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:58.982107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:59.002108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 639/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 1 15:39:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:59.009797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:59.129730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98127b-c02e-4b6a-83b2-4c4e64209fb3 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:59.168983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:59.169655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:59.169933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:59.170246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:59.231767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:59.245316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:59.246829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:59.357539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 616/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:39:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:59.366573 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:59.488274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c19d96-ebdf-41f0-89b7-bdf3185dfccd None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:59.504404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:59.528862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:59.529559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:59.529826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:59.530103 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:59.541180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:59.542729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:39:59.559801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:59.561254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:59.562329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:39:59.562329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:39:59.562329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:39:59.562329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:59.562329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 640/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:59.567518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:59.684674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:59.703921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb463-82ab-4d97-8fdb-9d622dbb3519 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:59.761333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:59.762116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:59.762289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:59.762562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:59.763257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:39:59.763564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:59.764962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:59.777470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 617/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:39:59.785474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:39:59.911171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de642-67f8-4813-b1c2-948e88e6dded None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:39:59.950758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:39:59.951405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:39:59.951689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:39:59.951966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:39:59.959251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:39:59.960791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:39:59.973205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:39:59.974626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:39:59.976735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 641/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:39:59.981463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:00.115170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c77f-d9d6-4376-84e9-056120b3b404 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:00.151322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38a8c0-61e4-4a98-a62d-ae5e3587554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:00.152039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38a8c0-61e4-4a98-a62d-ae5e3587554d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:00.152328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38a8c0-61e4-4a98-a62d-ae5e3587554d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:00.152609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38a8c0-61e4-4a98-a62d-ae5e3587554d None admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:00.153403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38a8c0-61e4-4a98-a62d-ae5e3587554d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:00.153767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38a8c0-61e4-4a98-a62d-ae5e3587554d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:00.155129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38a8c0-61e4-4a98-a62d-ae5e3587554d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:00.171467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 618/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:00.178309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:00.208028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:00.296262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a30d10-6110-4eeb-90fa-aac71b84eb1c None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:00.343944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eda208-50ae-4fac-9783-8b1f7cafb20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:00.344575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eda208-50ae-4fac-9783-8b1f7cafb20b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:00.344860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eda208-50ae-4fac-9783-8b1f7cafb20b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:00.345135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eda208-50ae-4fac-9783-8b1f7cafb20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:00.345972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eda208-50ae-4fac-9783-8b1f7cafb20b None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=7d1d3e9e0b7042978e47d3912df36daf) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:00.346346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eda208-50ae-4fac-9783-8b1f7cafb20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:00.347802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eda208-50ae-4fac-9783-8b1f7cafb20b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:00.356399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 642/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:40:00 2022] GET /identity/v3/role_assignments?user.id=7d1d3e9e0b7042978e47d3912df36daf&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:40:02.509742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919884c-da2e-46b6-9af3-9d029a542947 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:02.510284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919884c-da2e-46b6-9af3-9d029a542947 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:02.510284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919884c-da2e-46b6-9af3-9d029a542947 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:02.511668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 619/1261] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:40:02.517335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6e75-a0bf-4fb4-becf-dd6b6e3df2b5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:02.518028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6e75-a0bf-4fb4-becf-dd6b6e3df2b5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:02.518028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6e75-a0bf-4fb4-becf-dd6b6e3df2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:02.537656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-13cc6e75-a0bf-4fb4-becf-dd6b6e3df2b5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:02.538873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-13cc6e75-a0bf-4fb4-becf-dd6b6e3df2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:02.619040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 643/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:40:02.641054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919884c-da2e-46b6-9af3-9d029a542947 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:02.653498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:02.758218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919884c-da2e-46b6-9af3-9d029a542947 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:02.797037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:02.797726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:02.798021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:02.798291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:02.811412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:40:02.817728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:02.819848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:40:02.822399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 620/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:02.827402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc6e75-a0bf-4fb4-becf-dd6b6e3df2b5 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:02.854583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:02.943334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc6e75-a0bf-4fb4-becf-dd6b6e3df2b5 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:02.986896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:02.987528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:02.987813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:02.988098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:02.988826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:02.989139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:02.990571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.000373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 644/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:03.005889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:03.087729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:03.141840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ecb1a-905e-4f37-8127-ee5032583eea None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:03.184735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:03.185628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.185920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.186201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.212124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:03.212124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:40:03.231102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:03.232785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:03.235569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:40:03.235569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:40:03.235569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:03.235569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:40:03.237731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 621/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:03.240270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:03.342147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:03.362540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ecc00-e0c8-4a3e-a627-ed1125eda6cb None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:03.400246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:03.400860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.401139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.401428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.402152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:03.402459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:03.403835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.416754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 645/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:03.424293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:03.531868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f84a1-9256-4d4f-8c20-7c2bed7e7002 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:03.557451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:03.572343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:03.573002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.573284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.573593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.582256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:03.583743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:40:03.596288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:03.597557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:40:03.598735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 622/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:40:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:03.606867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:03.718429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdc586-476c-4b95-8d82-32ebffe18c29 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:03.766064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:03.766692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.766980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.767255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.768112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:03.768417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:03.770078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.780572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:03.793314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 646/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 1 15:40:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:03.798930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:03.919429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef279-919f-4d3d-87cd-45815f3cca9e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:03.962283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:03.962946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:03.963225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:03.963499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:03.976059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:03.978103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:40:03.993146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:04.007457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:04.008518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:40:04.008518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:40:04.008518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:04.008518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:40:04.008518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 623/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:04.008834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.131940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e0ee2-8539-4218-9e3f-b992554e5274 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.170831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.171469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.171752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.172026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.172733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:04.173036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.174486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.187350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 647/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:04.193246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.231349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:04.306698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3fcf-b790-4674-b770-7a6d3574f3b8 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.344266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.344934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.345215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.345488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.352788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.354422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:40:04.366418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:04.373479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:40:04.374480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 624/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:04.375094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.447253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:04.496736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7164b-a779-477f-af62-540ecc208360 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.534613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcf880-e747-4ba0-b246-cf591664f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.535237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcf880-e747-4ba0-b246-cf591664f307 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.535523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcf880-e747-4ba0-b246-cf591664f307 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.535801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcf880-e747-4ba0-b246-cf591664f307 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.536568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcf880-e747-4ba0-b246-cf591664f307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:04.536888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcf880-e747-4ba0-b246-cf591664f307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.538362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcf880-e747-4ba0-b246-cf591664f307 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.551472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 648/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:04.558363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:04.682973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:04.697949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e32a58-b4cb-4a14-a670-abbfb92f1aba None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:04.732634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946ee79-bbda-43c6-9419-5e656e3951dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:04.733316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ee79-bbda-43c6-9419-5e656e3951dc None admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:04.733632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ee79-bbda-43c6-9419-5e656e3951dc None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:04.733914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ee79-bbda-43c6-9419-5e656e3951dc None admin] PATH_INFO: `/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/7d1d3e9e0b7042978e47d3912df36daf/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:04.735897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946ee79-bbda-43c6-9419-5e656e3951dc None admin] RBAC: Authorizing `identity:create_grant(project_id=85b2a83e5a4a48d9a19f34be96478f74, user_id=7d1d3e9e0b7042978e47d3912df36daf, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:04.737337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946ee79-bbda-43c6-9419-5e656e3951dc None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:04.927980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 625/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 1 15:40:04 2022] PUT /identity/v3/projects/85b2a83e5a4a48d9a19f34be96478f74/users/7d1d3e9e0b7042978e47d3912df36daf/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:06.959633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ad98-e881-4d44-afc3-2bed55c4f403 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:06.960251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ad98-e881-4d44-afc3-2bed55c4f403 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:06.960251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ad98-e881-4d44-afc3-2bed55c4f403 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:06.962298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 649/1274] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:40:06.967617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e660a9-e53a-4842-a56b-a5c8b67f175e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:06.968131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e660a9-e53a-4842-a56b-a5c8b67f175e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:06.968247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e660a9-e53a-4842-a56b-a5c8b67f175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:06.988194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a7e660a9-e53a-4842-a56b-a5c8b67f175e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:06.989398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a7e660a9-e53a-4842-a56b-a5c8b67f175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:07.068524 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 626/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:40:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:40:07.093959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29ad98-e881-4d44-afc3-2bed55c4f403 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:07.207133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29ad98-e881-4d44-afc3-2bed55c4f403 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:07.226037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:07.248333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:07.249143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:07.249374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:07.249582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:07.260751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:40:07.265808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:07.266929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:07.268195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 650/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 1 15:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:07.273298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e660a9-e53a-4842-a56b-a5c8b67f175e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:07.379332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:07.409591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e660a9-e53a-4842-a56b-a5c8b67f175e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:07.457446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:07.458106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:07.458391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:07.458663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:07.459383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:07.459689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:07.461080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:07.470641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 627/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 1 15:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:07.479241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:07.597668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c591e-f97e-410a-9a87-3a2e1828d65a None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:07.637751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:07.638394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:07.639047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:07.639404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:07.650801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:07.652268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:40:07.666980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:07.668678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:07.670787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:40:07.670787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:40:07.670787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:07.670787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:07.670787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 651/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:07.676070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:07.834958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf68b5-4b05-4830-b2f0-89b9248d548d None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:07.871070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:07.871700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:07.871984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:07.872263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:07.872960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:07.873266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:07.874688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:07.887810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 628/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:07.894466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:07.929649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:08.008121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6f2d3-793c-4a49-9b0c-6f68c7be4a15 None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:08.047219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:08.047866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:08.048147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:08.048431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:08.057177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:08.058683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:40:08.070747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:08.072547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:08.073963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 652/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:40:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:08.078081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:08.082309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:08.187905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0bb0-66ba-4c48-838e-832162cb7621 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:08.231556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:08.232196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:08.232467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:08.232743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:08.233565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:08.233878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:08.235316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:08.255175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 629/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 1 15:40:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:08.261222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:08.382785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:08.394506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48e1be-889c-4f21-8b90-f17f96632d7e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:08.433802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:08.434442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:08.434727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:08.435013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:08.516847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:08.518343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:08.612170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:08.623891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 653/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 1 15:40:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:08.629753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:08.692200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:08.733633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe0a0a-6e21-47ec-8f3f-0a42ba6f7b6e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:08.772046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:08.772602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:08.772888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:08.773163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:08.784374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:08.785875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:40:08.800714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:08.801835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:08.802933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:40:08.802933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:40:08.802933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:40:08.802933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:40:08.805681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 630/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:08.808027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:08.910415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2d42-2ca3-4b37-a468-d3f68b2c237f None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:08.947807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:08.948295 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:08.948590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:08.948862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:08.949589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:08.949900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:08.951303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:08.964502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 654/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 1 15:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:08.970449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:09.076026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93223d7-6f68-4991-b42f-5ed7a999a10e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:09.095937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:09.116914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:09.117599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:09.118378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:09.118689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:09.129392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:09.131901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:40:09.144868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:09.145965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:40:09.147195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: ERROR keystone.server.flask.application Aug 01 15:40:09.149711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 631/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 1 15:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:09.154042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:09.209185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:09.261853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602eae6-1b85-4b4b-8976-2d464774e6ad None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:09.299656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a829fa0-a051-489a-bc60-b274f48e09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:09.301773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a829fa0-a051-489a-bc60-b274f48e09d3 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:09.301773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a829fa0-a051-489a-bc60-b274f48e09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:09.301773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a829fa0-a051-489a-bc60-b274f48e09d3 None admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:09.301773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a829fa0-a051-489a-bc60-b274f48e09d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:09.302124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a829fa0-a051-489a-bc60-b274f48e09d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:09.303454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a829fa0-a051-489a-bc60-b274f48e09d3 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:09.317330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 655/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 1 15:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:09.324609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:09.435870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d74d8-8d20-4385-896e-57912a12831e None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:09.481964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56379-15e5-40cb-b603-30327102af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:09.482582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56379-15e5-40cb-b603-30327102af4d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:09.482861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56379-15e5-40cb-b603-30327102af4d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:09.483134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56379-15e5-40cb-b603-30327102af4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:09.483925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56379-15e5-40cb-b603-30327102af4d None admin] RBAC: Adding query filter params (role.id=d1e7f6a67fff40aa8769dd1ac7373b07, scope.project.id=85b2a83e5a4a48d9a19f34be96478f74, user.id=7d1d3e9e0b7042978e47d3912df36daf) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:09.484236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56379-15e5-40cb-b603-30327102af4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:09.485735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56379-15e5-40cb-b603-30327102af4d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:09.492147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 632/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 1 15:40:09 2022] GET /identity/v3/role_assignments?user.id=7d1d3e9e0b7042978e47d3912df36daf&scope.project.id=85b2a83e5a4a48d9a19f34be96478f74&role.id=d1e7f6a67fff40aa8769dd1ac7373b07 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:40:11.561015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170ed9-d649-4bcc-9789-54919e42e776 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.562050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170ed9-d649-4bcc-9789-54919e42e776 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.562050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170ed9-d649-4bcc-9789-54919e42e776 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.562958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 656/1288] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:40:11.570591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cb7de-d8d2-467b-9bcc-3f76c4727974 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.571242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cb7de-d8d2-467b-9bcc-3f76c4727974 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.571242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cb7de-d8d2-467b-9bcc-3f76c4727974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.590574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-132cb7de-d8d2-467b-9bcc-3f76c4727974 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:11.591860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-132cb7de-d8d2-467b-9bcc-3f76c4727974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:11.624941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:11.666414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 633/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:40:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:40:11.688518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170ed9-d649-4bcc-9789-54919e42e776 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.800682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170ed9-d649-4bcc-9789-54919e42e776 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:11.814092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:11.849852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:11.850586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:11.850913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:11.851277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] PATH_INFO: `/v3/services/placement` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:11.852107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:11.854179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:11.864835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:11.866197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:11.867212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 657/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:40:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:11.873113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cb7de-d8d2-467b-9bcc-3f76c4727974 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:11.985897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cb7de-d8d2-467b-9bcc-3f76c4727974 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:12.025210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c6851-d7b1-424d-b981-61826de8796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:12.025859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c6851-d7b1-424d-b981-61826de8796a None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:12.026140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c6851-d7b1-424d-b981-61826de8796a None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:12.026417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c6851-d7b1-424d-b981-61826de8796a None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:12.027090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c6851-d7b1-424d-b981-61826de8796a None admin] RBAC: Adding query filter params (name=placement) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:12.027399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c6851-d7b1-424d-b981-61826de8796a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:12.028777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c6851-d7b1-424d-b981-61826de8796a None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:12.033826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 634/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 1 15:40:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:40:12.040499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:12.146161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f148246-ef5d-47dd-bac8-eb1bff56892b None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:12.186199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0add7bd-2a96-40b3-b2d7-610ff7828dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:12.187094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0add7bd-2a96-40b3-b2d7-610ff7828dbe None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:12.187412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0add7bd-2a96-40b3-b2d7-610ff7828dbe None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:12.187759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0add7bd-2a96-40b3-b2d7-610ff7828dbe None admin] PATH_INFO: `/v3/services` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:12.188900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0add7bd-2a96-40b3-b2d7-610ff7828dbe None admin] RBAC: Adding query filter params (type=placement) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:12.189243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0add7bd-2a96-40b3-b2d7-610ff7828dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:12.191273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0add7bd-2a96-40b3-b2d7-610ff7828dbe None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:12.203243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 658/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 1 15:40:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:14.310287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa5bb-4e8a-4c1e-9a41-4b42aee18d40 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:14.311178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa5bb-4e8a-4c1e-9a41-4b42aee18d40 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:14.311345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa5bb-4e8a-4c1e-9a41-4b42aee18d40 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:14.312800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 635/1293] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:40:14.318385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7408-b4f0-495b-bf5f-333cc618a685 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:14.319117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7408-b4f0-495b-bf5f-333cc618a685 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:14.319316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7408-b4f0-495b-bf5f-333cc618a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:14.339081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a56c7408-b4f0-495b-bf5f-333cc618a685 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:14.340915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a56c7408-b4f0-495b-bf5f-333cc618a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:14.372763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:14.411908 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 659/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:40:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:40:14.435780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa5bb-4e8a-4c1e-9a41-4b42aee18d40 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:14.472735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:14.549701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa5bb-4e8a-4c1e-9a41-4b42aee18d40 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:14.588609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005676c-aa21-4adc-b61d-e91ca0c41c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:14.589243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005676c-aa21-4adc-b61d-e91ca0c41c0d None admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:14.589554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005676c-aa21-4adc-b61d-e91ca0c41c0d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:14.589859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005676c-aa21-4adc-b61d-e91ca0c41c0d None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:14.590654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005676c-aa21-4adc-b61d-e91ca0c41c0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:14.592038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005676c-aa21-4adc-b61d-e91ca0c41c0d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:14.954963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 636/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 1 15:40:14 2022] POST /identity/v3/services => generated 246 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:17.012084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612959d9-8fab-4ed6-9058-2e3d92fa9b58 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:17.012732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612959d9-8fab-4ed6-9058-2e3d92fa9b58 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:17.012732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612959d9-8fab-4ed6-9058-2e3d92fa9b58 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:17.014174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 660/1296] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:40:17.021695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c189-16c3-47e9-9170-b9a35ac1eb67 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:17.022177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c189-16c3-47e9-9170-b9a35ac1eb67 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:17.022286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c189-16c3-47e9-9170-b9a35ac1eb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:17.043068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-6f54c189-16c3-47e9-9170-b9a35ac1eb67 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:17.044282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6f54c189-16c3-47e9-9170-b9a35ac1eb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:17.123625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 637/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:40:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:40:17.146449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612959d9-8fab-4ed6-9058-2e3d92fa9b58 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:17.264461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612959d9-8fab-4ed6-9058-2e3d92fa9b58 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:17.299460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:17.300353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:17.300471 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:17.300688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] PATH_INFO: `/v3/services/placement` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:17.301328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:17.302786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:17.312334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:17.313533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:17.314746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 661/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:40:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:17.319986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54c189-16c3-47e9-9170-b9a35ac1eb67 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:17.339471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:17.425772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54c189-16c3-47e9-9170-b9a35ac1eb67 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:17.460737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:17.461364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:17.461685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:17.461969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:17.462684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:17.462996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:17.464390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:17.470355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 638/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 1 15:40:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:17.476372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:17.511914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:17.585598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ff811-c8be-4db3-b06e-8be8a380ad6e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:17.620923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35fe2b-20dc-4ef5-a12d-c18bc02cbdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:17.621589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fe2b-20dc-4ef5-a12d-c18bc02cbdf5 None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:17.621871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fe2b-20dc-4ef5-a12d-c18bc02cbdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:17.622155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fe2b-20dc-4ef5-a12d-c18bc02cbdf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:17.622977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35fe2b-20dc-4ef5-a12d-c18bc02cbdf5 None admin] RBAC: Adding query filter params (interface=public, service_id=18850f470dce45d4a15dbc3d89f19200, region_id=RegionOne) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:17.623244 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35fe2b-20dc-4ef5-a12d-c18bc02cbdf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:17.624743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35fe2b-20dc-4ef5-a12d-c18bc02cbdf5 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:17.630466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 662/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 1 15:40:17 2022] GET /identity/v3/endpoints?service_id=18850f470dce45d4a15dbc3d89f19200&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:17.637183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:17.723797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:17.745271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b716-ee79-462d-b0a8-288b70c3db86 None admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:17.785881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a716c2-b0f7-4979-8635-c5660d0aee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:17.786542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a716c2-b0f7-4979-8635-c5660d0aee1d None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:17.786744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a716c2-b0f7-4979-8635-c5660d0aee1d None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:17.787027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a716c2-b0f7-4979-8635-c5660d0aee1d None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:17.787693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a716c2-b0f7-4979-8635-c5660d0aee1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:17.789123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a716c2-b0f7-4979-8635-c5660d0aee1d None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:17.797469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 639/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 1 15:40:17 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:19.864028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f1c8-cdef-4039-8c73-5f8f9fc74674 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:19.864754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f1c8-cdef-4039-8c73-5f8f9fc74674 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:19.864754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f1c8-cdef-4039-8c73-5f8f9fc74674 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:19.866041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 663/1302] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:40:19.871635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d621f2-25d1-410b-aa6e-51e722aaf6fd None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:19.872106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d621f2-25d1-410b-aa6e-51e722aaf6fd None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:19.872198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d621f2-25d1-410b-aa6e-51e722aaf6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:19.890551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f5d621f2-25d1-410b-aa6e-51e722aaf6fd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:19.891759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f5d621f2-25d1-410b-aa6e-51e722aaf6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:19.971634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 640/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:40:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:40:19.995053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961f1c8-cdef-4039-8c73-5f8f9fc74674 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:20.100532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:20.111340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961f1c8-cdef-4039-8c73-5f8f9fc74674 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:20.145705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:20.146301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:20.146547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:20.146819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] PATH_INFO: `/v3/services/placement` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:20.147481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:20.148864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:40:20.158216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:40:20.160076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application with Lock( Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: ERROR keystone.server.flask.application Aug 01 15:40:20.162025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 664/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 1 15:40:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:40:20.167509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d621f2-25d1-410b-aa6e-51e722aaf6fd None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:20.246613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:20.272312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d621f2-25d1-410b-aa6e-51e722aaf6fd None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:20.308639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a18c78-3e56-4590-a571-4fb2c7b7aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:20.309278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18c78-3e56-4590-a571-4fb2c7b7aa89 None admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:20.309587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18c78-3e56-4590-a571-4fb2c7b7aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:20.309871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18c78-3e56-4590-a571-4fb2c7b7aa89 None admin] PATH_INFO: `/v3/services` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:20.310550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a18c78-3e56-4590-a571-4fb2c7b7aa89 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:20.310858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a18c78-3e56-4590-a571-4fb2c7b7aa89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:20.312248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a18c78-3e56-4590-a571-4fb2c7b7aa89 None admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:20.317750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 641/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 1 15:40:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:20.324328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:20.434445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9226b-b034-4ef2-9181-e4475290417e None admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:20.471355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48973-213f-4add-b065-49bd336703b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:20.472372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48973-213f-4add-b065-49bd336703b4 None admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:20.472372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48973-213f-4add-b065-49bd336703b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:20.472614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48973-213f-4add-b065-49bd336703b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:20.473319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48973-213f-4add-b065-49bd336703b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:20.474750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48973-213f-4add-b065-49bd336703b4 None admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:20.671491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 665/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:40:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:30.481185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=30 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:30.666077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:28.021970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a12b-3aa1-4f1f-9efe-b45f55a6e44a None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.022411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a12b-3aa1-4f1f-9efe-b45f55a6e44a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.022411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a12b-3aa1-4f1f-9efe-b45f55a6e44a None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.032726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9917-b73b-44d6-9f74-05217b9dbe7c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.032726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9917-b73b-44d6-9f74-05217b9dbe7c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.032726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9917-b73b-44d6-9f74-05217b9dbe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.033675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 642/1307] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:28.119132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-32fd9917-b73b-44d6-9f74-05217b9dbe7c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:28.120569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-32fd9917-b73b-44d6-9f74-05217b9dbe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.256552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 666/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:28.481363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42e2a2-d76d-473b-8bd3-e600a0a80f24 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.481363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42e2a2-d76d-473b-8bd3-e600a0a80f24 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.481363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42e2a2-d76d-473b-8bd3-e600a0a80f24 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.481363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 643/1309] 10.222.0.77 () {54 vars in 965 bytes} [Mon Aug 1 15:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:28.481958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497efe14-f252-4aa8-9c04-c9b05e0c5c7b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.481958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497efe14-f252-4aa8-9c04-c9b05e0c5c7b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.481958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497efe14-f252-4aa8-9c04-c9b05e0c5c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.481958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-497efe14-f252-4aa8-9c04-c9b05e0c5c7b None None] MFA Rules not processed for user `90399c6cab2341f1af74d154c819bff9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:28.481958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-497efe14-f252-4aa8-9c04-c9b05e0c5c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.481958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:28.510825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 667/1310] 10.222.0.77 () {58 vars in 1062 bytes} [Mon Aug 1 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:28.519816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42e2a2-d76d-473b-8bd3-e600a0a80f24 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:28.521612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-eb42e2a2-d76d-473b-8bd3-e600a0a80f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.641976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42e2a2-d76d-473b-8bd3-e600a0a80f24 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:28.721693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300649d-ae00-41de-af5d-d3e48b39af3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:28.722322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300649d-ae00-41de-af5d-d3e48b39af3d service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:28.722606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300649d-ae00-41de-af5d-d3e48b39af3d service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:28.722889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300649d-ae00-41de-af5d-d3e48b39af3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:28.725186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7300649d-ae00-41de-af5d-d3e48b39af3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:28.781428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:28.836269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300649d-ae00-41de-af5d-d3e48b39af3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:28.837760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300649d-ae00-41de-af5d-d3e48b39af3d service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:28.861318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 644/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:49:31.216163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39ae9-cc34-41dd-9c20-f2eea47f46b1 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:31.216768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39ae9-cc34-41dd-9c20-f2eea47f46b1 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:31.216768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39ae9-cc34-41dd-9c20-f2eea47f46b1 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:31.221620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 668/1312] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:31.223501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b40b-b065-4dd2-9cdd-2d5bce59f2f6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:31.223976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b40b-b065-4dd2-9cdd-2d5bce59f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:31.224066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b40b-b065-4dd2-9cdd-2d5bce59f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:31.322031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8ab0b40b-b065-4dd2-9cdd-2d5bce59f2f6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:31.323262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8ab0b40b-b065-4dd2-9cdd-2d5bce59f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:31.447067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 645/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:31.486870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d39ae9-cc34-41dd-9c20-f2eea47f46b1 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:31.488424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-22d39ae9-cc34-41dd-9c20-f2eea47f46b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:31.628674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d39ae9-cc34-41dd-9c20-f2eea47f46b1 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:31.706648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:31.709377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86838a5-bba2-42c8-a18d-2fd45e5e892b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:31.710053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86838a5-bba2-42c8-a18d-2fd45e5e892b service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:31.710339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86838a5-bba2-42c8-a18d-2fd45e5e892b service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:31.710701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86838a5-bba2-42c8-a18d-2fd45e5e892b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:31.712489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a86838a5-bba2-42c8-a18d-2fd45e5e892b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:31.836822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86838a5-bba2-42c8-a18d-2fd45e5e892b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:31.838540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86838a5-bba2-42c8-a18d-2fd45e5e892b service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:31.860698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 669/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:34.435386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0b62-0124-42c3-95bc-c2636fa0e99b None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:34.435939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0b62-0124-42c3-95bc-c2636fa0e99b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:34.435939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0b62-0124-42c3-95bc-c2636fa0e99b None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:34.437628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 646/1315] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:34.442725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a6dab-4704-4d3b-bba6-af7bb9e6f32c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:34.443131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a6dab-4704-4d3b-bba6-af7bb9e6f32c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:34.443292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a6dab-4704-4d3b-bba6-af7bb9e6f32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:34.508383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-917a6dab-4704-4d3b-bba6-af7bb9e6f32c None None] MFA Rules not processed for user `70961e1242bf4fa29c96ec8ec07acb33`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:34.509912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-917a6dab-4704-4d3b-bba6-af7bb9e6f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:34.563588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:34.607846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 670/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:34.661838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622933-4d04-4287-be37-ba8d7f683e5a None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:34.662196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622933-4d04-4287-be37-ba8d7f683e5a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:34.662484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622933-4d04-4287-be37-ba8d7f683e5a None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:34.663873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 647/1317] 10.222.0.77 () {54 vars in 965 bytes} [Mon Aug 1 15:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:34.670128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74005739-9b0b-45bb-b4d2-9a3f8fba7e91 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:34.670410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74005739-9b0b-45bb-b4d2-9a3f8fba7e91 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:34.670684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74005739-9b0b-45bb-b4d2-9a3f8fba7e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:34.749733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-74005739-9b0b-45bb-b4d2-9a3f8fba7e91 None None] MFA Rules not processed for user `90399c6cab2341f1af74d154c819bff9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:34.753892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-74005739-9b0b-45bb-b4d2-9a3f8fba7e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:34.831434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 671/1318] 10.222.0.77 () {58 vars in 1062 bytes} [Mon Aug 1 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:34.841086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94622933-4d04-4287-be37-ba8d7f683e5a None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:34.842686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-94622933-4d04-4287-be37-ba8d7f683e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:34.853187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:34.948871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94622933-4d04-4287-be37-ba8d7f683e5a None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:35.027329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c915a4b-c690-42ba-ae4a-ecc74b647265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:35.027955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915a4b-c690-42ba-ae4a-ecc74b647265 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:35.028260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915a4b-c690-42ba-ae4a-ecc74b647265 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:35.028531 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915a4b-c690-42ba-ae4a-ecc74b647265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:35.030289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6c915a4b-c690-42ba-ae4a-ecc74b647265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:35.094436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:35.145798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c915a4b-c690-42ba-ae4a-ecc74b647265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:35.147257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c915a4b-c690-42ba-ae4a-ecc74b647265 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:35.167152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 648/1319] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:38.397738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b095-f991-4f5b-9c95-db7bb597971f None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:38.398294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b095-f991-4f5b-9c95-db7bb597971f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:38.398294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b095-f991-4f5b-9c95-db7bb597971f None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:38.399684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 672/1320] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:38.405126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cf0c-56ef-4e9e-9993-614fea4a8e2d None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:38.405610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cf0c-56ef-4e9e-9993-614fea4a8e2d None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:38.405709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cf0c-56ef-4e9e-9993-614fea4a8e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:38.474249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a946cf0c-56ef-4e9e-9993-614fea4a8e2d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:38.475480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a946cf0c-56ef-4e9e-9993-614fea4a8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:38.576007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 649/1321] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:38.615317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b095-f991-4f5b-9c95-db7bb597971f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:38.616864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-04f0b095-f991-4f5b-9c95-db7bb597971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:38.666682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:38.719389 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b095-f991-4f5b-9c95-db7bb597971f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:38.795388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e0eb5-cc26-497a-8671-52e99226d329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:38.796010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e0eb5-cc26-497a-8671-52e99226d329 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:38.796293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e0eb5-cc26-497a-8671-52e99226d329 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:38.796575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e0eb5-cc26-497a-8671-52e99226d329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:38.798264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-466e0eb5-cc26-497a-8671-52e99226d329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:38.906288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:38.921378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e0eb5-cc26-497a-8671-52e99226d329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:38.922861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e0eb5-cc26-497a-8671-52e99226d329 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:38.941499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 673/1322] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:42.066488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f119e-8749-4c6f-a252-847972061a87 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:42.067084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f119e-8749-4c6f-a252-847972061a87 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:42.067084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f119e-8749-4c6f-a252-847972061a87 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:42.068426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 650/1323] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:42.073996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6ba1-a3f9-4b87-a058-cddd3a234b3f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:42.074528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6ba1-a3f9-4b87-a058-cddd3a234b3f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:42.074624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6ba1-a3f9-4b87-a058-cddd3a234b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:42.139774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-bc6c6ba1-a3f9-4b87-a058-cddd3a234b3f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:42.141205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bc6c6ba1-a3f9-4b87-a058-cddd3a234b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:42.237026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 674/1324] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:42.272887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f119e-8749-4c6f-a252-847972061a87 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:42.274501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ed2f119e-8749-4c6f-a252-847972061a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:42.295244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:42.387345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f119e-8749-4c6f-a252-847972061a87 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:42.466510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef94bc-e722-445c-8d96-5fe4fddb384a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:42.467141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef94bc-e722-445c-8d96-5fe4fddb384a service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:42.467423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef94bc-e722-445c-8d96-5fe4fddb384a service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:42.467695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef94bc-e722-445c-8d96-5fe4fddb384a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:42.469362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-58ef94bc-e722-445c-8d96-5fe4fddb384a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:42.544490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:42.583891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef94bc-e722-445c-8d96-5fe4fddb384a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:42.585338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef94bc-e722-445c-8d96-5fe4fddb384a service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:42.604300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 651/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:44.676206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a9991-8ce8-4409-9b6a-af47a497c139 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.676754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a9991-8ce8-4409-9b6a-af47a497c139 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.676754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a9991-8ce8-4409-9b6a-af47a497c139 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.678266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 675/1326] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:44.683615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dae23-598b-4048-be21-e9a82551c5fa None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:44.684038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dae23-598b-4048-be21-e9a82551c5fa None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:44.684178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dae23-598b-4048-be21-e9a82551c5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:44.756698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b59dae23-598b-4048-be21-e9a82551c5fa None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:44.757957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b59dae23-598b-4048-be21-e9a82551c5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:44.861397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 652/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:44.901795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a9991-8ce8-4409-9b6a-af47a497c139 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:44.903325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-af5a9991-8ce8-4409-9b6a-af47a497c139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:44.968317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:45.015035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a9991-8ce8-4409-9b6a-af47a497c139 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:45.101717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d126a7-6d5c-40cc-8606-0b03856905b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:45.102479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d126a7-6d5c-40cc-8606-0b03856905b3 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:45.102961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d126a7-6d5c-40cc-8606-0b03856905b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:45.103308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d126a7-6d5c-40cc-8606-0b03856905b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:45.105526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-64d126a7-6d5c-40cc-8606-0b03856905b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:45.222575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:45.225203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d126a7-6d5c-40cc-8606-0b03856905b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:45.226706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d126a7-6d5c-40cc-8606-0b03856905b3 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:45.248547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 676/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:47.326997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ee66-5d93-4d2a-b91f-edf5d0e2dc0b None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:47.327529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ee66-5d93-4d2a-b91f-edf5d0e2dc0b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:47.327529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ee66-5d93-4d2a-b91f-edf5d0e2dc0b None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:47.328910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 653/1329] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:47.334435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692873-a610-429f-ac38-372d23bb5565 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:47.334943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692873-a610-429f-ac38-372d23bb5565 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:47.335038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692873-a610-429f-ac38-372d23bb5565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:47.411308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-bf692873-a610-429f-ac38-372d23bb5565 None None] MFA Rules not processed for user `70961e1242bf4fa29c96ec8ec07acb33`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:47.412648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bf692873-a610-429f-ac38-372d23bb5565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:47.515819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 677/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:47.553497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ee66-5d93-4d2a-b91f-edf5d0e2dc0b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:47.555040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ea69ee66-5d93-4d2a-b91f-edf5d0e2dc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:47.588462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:47.665037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ee66-5d93-4d2a-b91f-edf5d0e2dc0b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:47.751731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae805c-45d0-4291-89fe-6ddb1527fef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:47.752377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae805c-45d0-4291-89fe-6ddb1527fef5 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:47.752668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae805c-45d0-4291-89fe-6ddb1527fef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:47.752950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae805c-45d0-4291-89fe-6ddb1527fef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:47.755132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-58ae805c-45d0-4291-89fe-6ddb1527fef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:47.833839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:47.865680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae805c-45d0-4291-89fe-6ddb1527fef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:47.867132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae805c-45d0-4291-89fe-6ddb1527fef5 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:47.885808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 654/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:50.319338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fcf6-134c-403b-a015-f6859e98ce1b None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:50.319865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fcf6-134c-403b-a015-f6859e98ce1b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:50.319970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fcf6-134c-403b-a015-f6859e98ce1b None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:50.321263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 678/1332] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:50.326385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b327acf-334f-4980-a04c-f53dd8f1fe94 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:50.326798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b327acf-334f-4980-a04c-f53dd8f1fe94 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:50.326949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b327acf-334f-4980-a04c-f53dd8f1fe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:50.392446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0b327acf-334f-4980-a04c-f53dd8f1fe94 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:50.395822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0b327acf-334f-4980-a04c-f53dd8f1fe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:50.501229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 655/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:50.538940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fcf6-134c-403b-a015-f6859e98ce1b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:50.540467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b2f4fcf6-134c-403b-a015-f6859e98ce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:50.609073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:50.642130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fcf6-134c-403b-a015-f6859e98ce1b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:50.714853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed2905-8cd7-4510-afc6-61f56db990cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:50.715494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2905-8cd7-4510-afc6-61f56db990cc service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:50.715782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2905-8cd7-4510-afc6-61f56db990cc service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:50.716057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2905-8cd7-4510-afc6-61f56db990cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:50.717689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f2ed2905-8cd7-4510-afc6-61f56db990cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:50.823290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2905-8cd7-4510-afc6-61f56db990cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:50.824731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2905-8cd7-4510-afc6-61f56db990cc service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:50.835364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:50.843553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 679/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:52.918937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701363-48e1-4646-b7fe-26be72875b9b None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:52.919525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701363-48e1-4646-b7fe-26be72875b9b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:52.919525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701363-48e1-4646-b7fe-26be72875b9b None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:52.920920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 656/1335] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:52.926794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d44a6-54ce-43af-b297-7f96e7e20972 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:52.927254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d44a6-54ce-43af-b297-7f96e7e20972 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:52.927368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d44a6-54ce-43af-b297-7f96e7e20972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:53.002565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-704d44a6-54ce-43af-b297-7f96e7e20972 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:53.004407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-704d44a6-54ce-43af-b297-7f96e7e20972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:53.103221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 680/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:53.142908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701363-48e1-4646-b7fe-26be72875b9b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:53.144451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cd701363-48e1-4646-b7fe-26be72875b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:53.184610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:53.249158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701363-48e1-4646-b7fe-26be72875b9b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:53.323980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026578ce-3eb6-4782-a255-cebcd1a77c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:53.324602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026578ce-3eb6-4782-a255-cebcd1a77c59 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:53.324882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026578ce-3eb6-4782-a255-cebcd1a77c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:53.325159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026578ce-3eb6-4782-a255-cebcd1a77c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:53.326832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-026578ce-3eb6-4782-a255-cebcd1a77c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:53.413610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:53.439225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026578ce-3eb6-4782-a255-cebcd1a77c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:53.440607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026578ce-3eb6-4782-a255-cebcd1a77c59 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:53.459371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 657/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:56.100734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c64c48-1b8e-4090-8ba9-9e2ab01b43ba None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:56.101285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c64c48-1b8e-4090-8ba9-9e2ab01b43ba None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:56.101285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c64c48-1b8e-4090-8ba9-9e2ab01b43ba None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:56.102618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 681/1338] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:49:56.107841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378faa46-5a74-4061-8c24-6fcfcba4afbb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:56.108281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378faa46-5a74-4061-8c24-6fcfcba4afbb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:56.108393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378faa46-5a74-4061-8c24-6fcfcba4afbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:56.184172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-378faa46-5a74-4061-8c24-6fcfcba4afbb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:56.185383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-378faa46-5a74-4061-8c24-6fcfcba4afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:56.285915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 658/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:56.322836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c64c48-1b8e-4090-8ba9-9e2ab01b43ba None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:56.324363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-32c64c48-1b8e-4090-8ba9-9e2ab01b43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:56.403345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:56.431184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c64c48-1b8e-4090-8ba9-9e2ab01b43ba None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:56.504571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3bd41-80f6-4007-84c6-138394202324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:56.505196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3bd41-80f6-4007-84c6-138394202324 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:56.505483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3bd41-80f6-4007-84c6-138394202324 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:56.505796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3bd41-80f6-4007-84c6-138394202324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:56.507510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-68d3bd41-80f6-4007-84c6-138394202324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:56.620064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3bd41-80f6-4007-84c6-138394202324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:56.621540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3bd41-80f6-4007-84c6-138394202324 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:56.646867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 682/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:00.912406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feef06-12da-4514-9ca8-c71b42f32ade None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:00.912946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feef06-12da-4514-9ca8-c71b42f32ade None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:00.912946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feef06-12da-4514-9ca8-c71b42f32ade None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:00.914386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 659/1341] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:00.920434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be9119-83e1-4c7a-9ac8-32a9a0cd5ea5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:00.920892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be9119-83e1-4c7a-9ac8-32a9a0cd5ea5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:00.920986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be9119-83e1-4c7a-9ac8-32a9a0cd5ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:00.926584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:00.990175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d0be9119-83e1-4c7a-9ac8-32a9a0cd5ea5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:00.991389 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d0be9119-83e1-4c7a-9ac8-32a9a0cd5ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:01.090637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 683/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:01.133385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feef06-12da-4514-9ca8-c71b42f32ade None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:01.135030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a4feef06-12da-4514-9ca8-c71b42f32ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:01.186562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:01.243595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feef06-12da-4514-9ca8-c71b42f32ade None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:01.332355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4486-31b7-42c1-9049-1dd707b7b806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:01.332977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4486-31b7-42c1-9049-1dd707b7b806 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:01.333257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4486-31b7-42c1-9049-1dd707b7b806 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:01.333547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4486-31b7-42c1-9049-1dd707b7b806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:01.335321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a69a4486-31b7-42c1-9049-1dd707b7b806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:01.431666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:01.450238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4486-31b7-42c1-9049-1dd707b7b806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:01.451678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4486-31b7-42c1-9049-1dd707b7b806 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:01.471397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 660/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:04.496335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e946a08-2817-4d73-90e8-b2dab7098d22 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:04.497213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e946a08-2817-4d73-90e8-b2dab7098d22 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:04.497213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e946a08-2817-4d73-90e8-b2dab7098d22 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:04.498322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 684/1344] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:04.504968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472f94-ab3e-4dc8-bff1-88450ffba008 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:04.505501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472f94-ab3e-4dc8-bff1-88450ffba008 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:04.505726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472f94-ab3e-4dc8-bff1-88450ffba008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:04.591489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-25472f94-ab3e-4dc8-bff1-88450ffba008 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:04.592647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-25472f94-ab3e-4dc8-bff1-88450ffba008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:04.701890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 661/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:04.740361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e946a08-2817-4d73-90e8-b2dab7098d22 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:04.741979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1e946a08-2817-4d73-90e8-b2dab7098d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:04.838675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:04.856719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e946a08-2817-4d73-90e8-b2dab7098d22 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:04.937319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d4e50-49ec-422e-9692-a4ff6be621b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:04.937842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4e50-49ec-422e-9692-a4ff6be621b5 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:04.938123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4e50-49ec-422e-9692-a4ff6be621b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:04.938453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4e50-49ec-422e-9692-a4ff6be621b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:04.940060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a45d4e50-49ec-422e-9692-a4ff6be621b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:05.072322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d4e50-49ec-422e-9692-a4ff6be621b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:05.073802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d4e50-49ec-422e-9692-a4ff6be621b5 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:05.093309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 685/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:09.975090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140835d-bffd-4b7c-959c-1fa7cc9cc438 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:09.975651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140835d-bffd-4b7c-959c-1fa7cc9cc438 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:09.975651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140835d-bffd-4b7c-959c-1fa7cc9cc438 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:09.983202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 662/1347] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:09.985073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f10a-8b53-47e2-bc4a-9356de8f827f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:09.985775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f10a-8b53-47e2-bc4a-9356de8f827f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:09.985775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f10a-8b53-47e2-bc4a-9356de8f827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:10.009581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:10.076953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2df1f10a-8b53-47e2-bc4a-9356de8f827f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:10.078401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2df1f10a-8b53-47e2-bc4a-9356de8f827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:10.212588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 686/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:50:10.252246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140835d-bffd-4b7c-959c-1fa7cc9cc438 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:10.254712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9140835d-bffd-4b7c-959c-1fa7cc9cc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:10.326705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:10.385294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140835d-bffd-4b7c-959c-1fa7cc9cc438 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:10.480724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51b2a9-f833-4f27-a758-6f38b0f09475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:10.481854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51b2a9-f833-4f27-a758-6f38b0f09475 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:10.482330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51b2a9-f833-4f27-a758-6f38b0f09475 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:10.482751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51b2a9-f833-4f27-a758-6f38b0f09475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:10.485973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4b51b2a9-f833-4f27-a758-6f38b0f09475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:10.628700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:10.633241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51b2a9-f833-4f27-a758-6f38b0f09475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:10.635463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51b2a9-f833-4f27-a758-6f38b0f09475 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:10.665943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 663/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:16.350433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a566a6-5bac-4175-9981-a8e96d46ff2e None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:16.350963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a566a6-5bac-4175-9981-a8e96d46ff2e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:16.351279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a566a6-5bac-4175-9981-a8e96d46ff2e None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:16.358148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 687/1350] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:50:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:16.375719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409bf4-5a6e-445c-af0e-90f7addc8f27 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:16.376237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409bf4-5a6e-445c-af0e-90f7addc8f27 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:16.376797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409bf4-5a6e-445c-af0e-90f7addc8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:16.463008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0b409bf4-5a6e-445c-af0e-90f7addc8f27 None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:16.464256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0b409bf4-5a6e-445c-af0e-90f7addc8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:16.581710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 664/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:50:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:20.210494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=59 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:20.979872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e21d8-3b07-44b2-8b01-d1898292bea6 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:20.980635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e21d8-3b07-44b2-8b01-d1898292bea6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:20.981033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e21d8-3b07-44b2-8b01-d1898292bea6 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:20.982590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 688/1352] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:20.988427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5be311-3d5e-4e88-bff9-3a318ed6ba9f None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:20.989532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5be311-3d5e-4e88-bff9-3a318ed6ba9f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:20.989532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5be311-3d5e-4e88-bff9-3a318ed6ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:21.060010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:21.085337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-5f5be311-3d5e-4e88-bff9-3a318ed6ba9f None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:21.086861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5f5be311-3d5e-4e88-bff9-3a318ed6ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:21.239471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 665/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:50:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:22.668604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae091a3-c1e6-42e4-be38-435768b262b8 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:22.669127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae091a3-c1e6-42e4-be38-435768b262b8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:22.669127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae091a3-c1e6-42e4-be38-435768b262b8 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:22.670604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 689/1354] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:22.675754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aab59-fe11-4341-b5a8-d3bcc6691cfb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:22.676452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aab59-fe11-4341-b5a8-d3bcc6691cfb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:22.676452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aab59-fe11-4341-b5a8-d3bcc6691cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:22.755613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d65aab59-fe11-4341-b5a8-d3bcc6691cfb None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:22.756854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d65aab59-fe11-4341-b5a8-d3bcc6691cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:22.816723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:22.886161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 666/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:50:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:26.297970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbf6f-91e4-43ab-82c9-f2712de3f875 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:26.298594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbf6f-91e4-43ab-82c9-f2712de3f875 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:26.299242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbf6f-91e4-43ab-82c9-f2712de3f875 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:26.300571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 690/1356] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:26.306406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978962-0b7a-42e7-b719-fc81f9820254 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:26.306845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978962-0b7a-42e7-b719-fc81f9820254 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:26.306992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978962-0b7a-42e7-b719-fc81f9820254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:26.394913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-24978962-0b7a-42e7-b719-fc81f9820254 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:26.396403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-24978962-0b7a-42e7-b719-fc81f9820254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:26.551263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 667/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:26.628338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaed48-370f-4b21-9738-a5f9b303a3f9 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:26.629330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaed48-370f-4b21-9738-a5f9b303a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:26.629818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaed48-370f-4b21-9738-a5f9b303a3f9 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:26.632590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 691/1358] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 1 15:50:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:26.637947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e8f6-67ee-4599-ada7-8c0ba070770c None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:26.638510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e8f6-67ee-4599-ada7-8c0ba070770c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:26.639243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e8f6-67ee-4599-ada7-8c0ba070770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:26.657097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:26.726082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0ae1e8f6-67ee-4599-ada7-8c0ba070770c None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:26.727673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0ae1e8f6-67ee-4599-ada7-8c0ba070770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:26.892066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 668/1359] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 1 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:26.900039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaed48-370f-4b21-9738-a5f9b303a3f9 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:26.901899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-74eaed48-370f-4b21-9738-a5f9b303a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:27.076710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaed48-370f-4b21-9738-a5f9b303a3f9 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:27.172632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:27.223456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d9e57-76ad-47ca-981a-290a9163596c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:27.224135 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d9e57-76ad-47ca-981a-290a9163596c service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:27.224432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d9e57-76ad-47ca-981a-290a9163596c service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:27.224852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d9e57-76ad-47ca-981a-290a9163596c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:27.227382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9d6d9e57-76ad-47ca-981a-290a9163596c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:27.353779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d9e57-76ad-47ca-981a-290a9163596c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:27.355499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d9e57-76ad-47ca-981a-290a9163596c service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:27.375962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 692/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:29.652306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a78853-1e5d-433c-8608-583506797340 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:29.652913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a78853-1e5d-433c-8608-583506797340 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:29.652913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a78853-1e5d-433c-8608-583506797340 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:29.654575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 669/1361] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:29.660733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3274ba-9122-45c5-a8cb-0d8ee98d5c77 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:29.661246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3274ba-9122-45c5-a8cb-0d8ee98d5c77 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:29.661328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3274ba-9122-45c5-a8cb-0d8ee98d5c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:29.740506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0e3274ba-9122-45c5-a8cb-0d8ee98d5c77 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:29.741898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0e3274ba-9122-45c5-a8cb-0d8ee98d5c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:29.785713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:29.859475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 693/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:29.909139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a78853-1e5d-433c-8608-583506797340 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:29.910791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-02a78853-1e5d-433c-8608-583506797340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:29.999725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:30.122351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a78853-1e5d-433c-8608-583506797340 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:30.302335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdf010-2ee6-4a9c-8e30-261ccc3685c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:30.302968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdf010-2ee6-4a9c-8e30-261ccc3685c0 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:30.303440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdf010-2ee6-4a9c-8e30-261ccc3685c0 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:30.303725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdf010-2ee6-4a9c-8e30-261ccc3685c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:30.305435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9fbdf010-2ee6-4a9c-8e30-261ccc3685c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:30.332611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:30.414150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdf010-2ee6-4a9c-8e30-261ccc3685c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:30.416460 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdf010-2ee6-4a9c-8e30-261ccc3685c0 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:30.437434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 670/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:32.962072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d17ba-f5b7-422a-8d41-95d727e13dca None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:32.963163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d17ba-f5b7-422a-8d41-95d727e13dca None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:32.963436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d17ba-f5b7-422a-8d41-95d727e13dca None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:32.965230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 694/1364] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:32.971658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e16b9-8105-4e0a-8772-a36278d2c2dc None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:32.972368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e16b9-8105-4e0a-8772-a36278d2c2dc None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:32.972368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e16b9-8105-4e0a-8772-a36278d2c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:33.055203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1b2e16b9-8105-4e0a-8772-a36278d2c2dc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:33.056443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1b2e16b9-8105-4e0a-8772-a36278d2c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:33.200430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:33.205573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 671/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:33.257491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0957-51ee-450b-ac3d-523296b6c074 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:33.258417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0957-51ee-450b-ac3d-523296b6c074 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:33.258970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0957-51ee-450b-ac3d-523296b6c074 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:33.261083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 695/1366] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 1 15:50:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:33.267979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a9f6-5dd3-438e-b95a-343baa79966c None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:33.268410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a9f6-5dd3-438e-b95a-343baa79966c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:33.268720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a9f6-5dd3-438e-b95a-343baa79966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:33.393389 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-3455a9f6-5dd3-438e-b95a-343baa79966c None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:33.395311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3455a9f6-5dd3-438e-b95a-343baa79966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:33.552734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 672/1367] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 1 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:33.561313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0957-51ee-450b-ac3d-523296b6c074 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:33.562885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-427b0957-51ee-450b-ac3d-523296b6c074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:33.759133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0957-51ee-450b-ac3d-523296b6c074 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:33.782078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:33.881393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370364d9-05c0-4304-8b4e-787d83926a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:33.882114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370364d9-05c0-4304-8b4e-787d83926a06 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:33.882403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370364d9-05c0-4304-8b4e-787d83926a06 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:33.882683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370364d9-05c0-4304-8b4e-787d83926a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:33.885999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-370364d9-05c0-4304-8b4e-787d83926a06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:33.984237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370364d9-05c0-4304-8b4e-787d83926a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:33.986444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370364d9-05c0-4304-8b4e-787d83926a06 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:34.006466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 696/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:34.888212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ce92-b685-46e1-9b49-911a1ec02d44 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:34.888783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ce92-b685-46e1-9b49-911a1ec02d44 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:34.888783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ce92-b685-46e1-9b49-911a1ec02d44 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:34.890408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 673/1369] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:34.896199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214e6e7-fda8-436b-b94a-5d7e588387c1 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:34.896489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214e6e7-fda8-436b-b94a-5d7e588387c1 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:34.896776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214e6e7-fda8-436b-b94a-5d7e588387c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:34.931030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:34.971453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4214e6e7-fda8-436b-b94a-5d7e588387c1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:34.973264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4214e6e7-fda8-436b-b94a-5d7e588387c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:35.081597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 697/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:50:35.429678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f9cd3-42df-44ac-a1db-ae0ec955faf8 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:35.429678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f9cd3-42df-44ac-a1db-ae0ec955faf8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:35.429678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f9cd3-42df-44ac-a1db-ae0ec955faf8 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:35.429678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 674/1371] 10.222.0.77 () {54 vars in 964 bytes} [Mon Aug 1 15:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:35.434267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a636257-68b3-471c-aa7c-612a57305829 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:35.434267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a636257-68b3-471c-aa7c-612a57305829 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:35.434267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a636257-68b3-471c-aa7c-612a57305829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:35.521462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8a636257-68b3-471c-aa7c-612a57305829 None None] MFA Rules not processed for user `6bdef4163b5048ed9c9815683a44f019`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:35.522855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8a636257-68b3-471c-aa7c-612a57305829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:35.572200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:35.605899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 698/1372] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Aug 1 15:50:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:35.614482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f9cd3-42df-44ac-a1db-ae0ec955faf8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:35.616002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0e9f9cd3-42df-44ac-a1db-ae0ec955faf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:35.673861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:35.735400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f9cd3-42df-44ac-a1db-ae0ec955faf8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:35.821844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23741926-e188-4148-bb46-4d268db6cdbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:35.822525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23741926-e188-4148-bb46-4d268db6cdbe service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:35.822751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23741926-e188-4148-bb46-4d268db6cdbe service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:35.823033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23741926-e188-4148-bb46-4d268db6cdbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:35.824944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-23741926-e188-4148-bb46-4d268db6cdbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:35.943827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:35.959243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23741926-e188-4148-bb46-4d268db6cdbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:35.960702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23741926-e188-4148-bb46-4d268db6cdbe service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:35.983650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 675/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:36.329053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4c202-366c-4bfe-87d2-e9dd484ba50b None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:36.330262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4c202-366c-4bfe-87d2-e9dd484ba50b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:36.330262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4c202-366c-4bfe-87d2-e9dd484ba50b None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:36.331995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 699/1374] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:36.337492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e54a3-fa85-4505-a137-b3a6e323c608 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:36.337822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e54a3-fa85-4505-a137-b3a6e323c608 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:36.338103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e54a3-fa85-4505-a137-b3a6e323c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:36.426047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dc1e54a3-fa85-4505-a137-b3a6e323c608 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:36.427295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dc1e54a3-fa85-4505-a137-b3a6e323c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:36.532178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 676/1375] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:36.578626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4c202-366c-4bfe-87d2-e9dd484ba50b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:36.580650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4bf4c202-366c-4bfe-87d2-e9dd484ba50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:36.745376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4c202-366c-4bfe-87d2-e9dd484ba50b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:36.804758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:36.870277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5f6ad-06e7-407e-b906-c37cad2690ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:36.870803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5f6ad-06e7-407e-b906-c37cad2690ff service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:36.871090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5f6ad-06e7-407e-b906-c37cad2690ff service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:36.871372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5f6ad-06e7-407e-b906-c37cad2690ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:36.873085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-30c5f6ad-06e7-407e-b906-c37cad2690ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:36.967836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5f6ad-06e7-407e-b906-c37cad2690ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:36.969449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5f6ad-06e7-407e-b906-c37cad2690ff service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:36.987857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 700/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:39.269467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300827b-58e3-406b-bc63-4d34595b32a9 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:39.270012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300827b-58e3-406b-bc63-4d34595b32a9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:39.270111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300827b-58e3-406b-bc63-4d34595b32a9 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:39.271513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 677/1377] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:39.279773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6461-404f-4604-b107-ba23a7f863e1 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:39.280267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6461-404f-4604-b107-ba23a7f863e1 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:39.280373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6461-404f-4604-b107-ba23a7f863e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:39.359788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e99d6461-404f-4604-b107-ba23a7f863e1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:39.361057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e99d6461-404f-4604-b107-ba23a7f863e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:39.371187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:39.472494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 701/1378] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:39.518192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300827b-58e3-406b-bc63-4d34595b32a9 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:39.519771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1300827b-58e3-406b-bc63-4d34595b32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:39.584170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:39.712303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300827b-58e3-406b-bc63-4d34595b32a9 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:39.894320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2515-7158-443b-8209-8d3526ffb2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:39.895284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2515-7158-443b-8209-8d3526ffb2b3 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:39.895705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2515-7158-443b-8209-8d3526ffb2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:39.895995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2515-7158-443b-8209-8d3526ffb2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:39.897711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-88bf2515-7158-443b-8209-8d3526ffb2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:39.918377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:40.020225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf2515-7158-443b-8209-8d3526ffb2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:40.021889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf2515-7158-443b-8209-8d3526ffb2b3 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:40.043059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 678/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:50:42.270692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca82c-2152-4725-b8b1-79a3b647a3e3 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:42.271227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca82c-2152-4725-b8b1-79a3b647a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:42.271227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca82c-2152-4725-b8b1-79a3b647a3e3 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:42.272581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 702/1380] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:42.279204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f37d-067c-4f8b-ae7d-5de19b6e4e34 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:42.279978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f37d-067c-4f8b-ae7d-5de19b6e4e34 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:42.280407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f37d-067c-4f8b-ae7d-5de19b6e4e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:42.354227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2701f37d-067c-4f8b-ae7d-5de19b6e4e34 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:42.355460 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2701f37d-067c-4f8b-ae7d-5de19b6e4e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:42.489251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:42.496658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 679/1381] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:42.543119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ca82c-2152-4725-b8b1-79a3b647a3e3 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:42.544611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8f9ca82c-2152-4725-b8b1-79a3b647a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:42.692380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:42.702920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ca82c-2152-4725-b8b1-79a3b647a3e3 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:42.830377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32da7c-fd09-4ae4-aad1-f30f6c3e4859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:42.831000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32da7c-fd09-4ae4-aad1-f30f6c3e4859 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:42.832299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32da7c-fd09-4ae4-aad1-f30f6c3e4859 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:42.832725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32da7c-fd09-4ae4-aad1-f30f6c3e4859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:42.834176 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ea32da7c-fd09-4ae4-aad1-f30f6c3e4859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:42.930287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32da7c-fd09-4ae4-aad1-f30f6c3e4859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:42.931969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32da7c-fd09-4ae4-aad1-f30f6c3e4859 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:42.945447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:42.956341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 703/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:45.248771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9ffdb-b0ca-4d24-b9cc-0e344dce1d14 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:45.249464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9ffdb-b0ca-4d24-b9cc-0e344dce1d14 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:45.249464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9ffdb-b0ca-4d24-b9cc-0e344dce1d14 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:45.251538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 680/1383] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:45.257453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14e96-7a81-4d40-b043-01593c94e50e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:45.258431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14e96-7a81-4d40-b043-01593c94e50e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:45.258431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14e96-7a81-4d40-b043-01593c94e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:45.349400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-dfa14e96-7a81-4d40-b043-01593c94e50e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:45.350658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-dfa14e96-7a81-4d40-b043-01593c94e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:45.465949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 704/1384] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:45.511119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9ffdb-b0ca-4d24-b9cc-0e344dce1d14 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:45.512711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b9d9ffdb-b0ca-4d24-b9cc-0e344dce1d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:45.684143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9ffdb-b0ca-4d24-b9cc-0e344dce1d14 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:45.759596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:45.809456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff023-800f-4e87-8046-486a2da46d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:45.810113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff023-800f-4e87-8046-486a2da46d1e service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:45.810919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff023-800f-4e87-8046-486a2da46d1e service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:45.811619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff023-800f-4e87-8046-486a2da46d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:45.814020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-628ff023-800f-4e87-8046-486a2da46d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:45.916030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff023-800f-4e87-8046-486a2da46d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:45.917762 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff023-800f-4e87-8046-486a2da46d1e service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:45.936729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 681/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:48.241580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531435b-ce48-4933-b728-82d69df4129c None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:48.242781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531435b-ce48-4933-b728-82d69df4129c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:48.242781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531435b-ce48-4933-b728-82d69df4129c None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:48.243590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 705/1386] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:50:48.249275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386918e-f09c-4270-92ef-93f3d8af5c89 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:48.249811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386918e-f09c-4270-92ef-93f3d8af5c89 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:48.249958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386918e-f09c-4270-92ef-93f3d8af5c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:48.331233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4386918e-f09c-4270-92ef-93f3d8af5c89 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:48.333305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4386918e-f09c-4270-92ef-93f3d8af5c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:48.375785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:48.480107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 682/1387] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:48.531095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531435b-ce48-4933-b728-82d69df4129c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:48.532981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3531435b-ce48-4933-b728-82d69df4129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:48.622924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:48.706527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531435b-ce48-4933-b728-82d69df4129c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:48.835807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca09b6-96ad-4d58-9e3a-93757d008c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:48.836367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca09b6-96ad-4d58-9e3a-93757d008c98 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:48.836697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca09b6-96ad-4d58-9e3a-93757d008c98 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:48.836988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca09b6-96ad-4d58-9e3a-93757d008c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:48.838943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-95ca09b6-96ad-4d58-9e3a-93757d008c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:48.885058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:48.947385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca09b6-96ad-4d58-9e3a-93757d008c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:48.949093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca09b6-96ad-4d58-9e3a-93757d008c98 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:48.969562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 706/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:50:51.289803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fed034-f2b1-43ee-abbf-866bd0d79157 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:51.290640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fed034-f2b1-43ee-abbf-866bd0d79157 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:51.290640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fed034-f2b1-43ee-abbf-866bd0d79157 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:51.292032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 683/1389] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:51.298026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04245d7-bc3d-4cb9-a3ce-8a9f3051dd49 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:51.298580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04245d7-bc3d-4cb9-a3ce-8a9f3051dd49 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:51.298580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04245d7-bc3d-4cb9-a3ce-8a9f3051dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:51.368268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e04245d7-bc3d-4cb9-a3ce-8a9f3051dd49 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:51.369490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e04245d7-bc3d-4cb9-a3ce-8a9f3051dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:51.482392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 707/1390] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:51.532621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fed034-f2b1-43ee-abbf-866bd0d79157 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:51.534170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d8fed034-f2b1-43ee-abbf-866bd0d79157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:51.701013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fed034-f2b1-43ee-abbf-866bd0d79157 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:51.718297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:51.815991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae60419-9d43-4781-9bae-ec87e0013b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:51.816615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae60419-9d43-4781-9bae-ec87e0013b33 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:51.816900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae60419-9d43-4781-9bae-ec87e0013b33 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:51.817177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae60419-9d43-4781-9bae-ec87e0013b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:51.818812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-eae60419-9d43-4781-9bae-ec87e0013b33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:51.919635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae60419-9d43-4781-9bae-ec87e0013b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:51.921256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae60419-9d43-4781-9bae-ec87e0013b33 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:51.941770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 684/1391] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:53.111738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808901-6273-4869-a8d2-d5293de50ffe None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:53.112563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808901-6273-4869-a8d2-d5293de50ffe None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:53.112563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808901-6273-4869-a8d2-d5293de50ffe None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:53.113818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 708/1392] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:53.119340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d08d7-5c61-4fde-a5e2-d19839cb79ce None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:53.120035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d08d7-5c61-4fde-a5e2-d19839cb79ce None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:53.120354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d08d7-5c61-4fde-a5e2-d19839cb79ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:53.147371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:53.195106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4f2d08d7-5c61-4fde-a5e2-d19839cb79ce None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:53.196373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4f2d08d7-5c61-4fde-a5e2-d19839cb79ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:53.297833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 685/1393] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:53.353619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654928-7b29-4d9c-915b-a8b6f5067f48 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:53.353910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654928-7b29-4d9c-915b-a8b6f5067f48 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:53.354189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654928-7b29-4d9c-915b-a8b6f5067f48 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:53.355546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 709/1394] 10.222.0.77 () {54 vars in 966 bytes} [Mon Aug 1 15:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:53.361116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc7f5-dfc6-4f9b-beb5-1d561e735849 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:53.361435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc7f5-dfc6-4f9b-beb5-1d561e735849 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:53.361720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc7f5-dfc6-4f9b-beb5-1d561e735849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:53.444506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c24cc7f5-dfc6-4f9b-beb5-1d561e735849 None None] MFA Rules not processed for user `5048d76e4ffb4e12bb76ad3c8e5095ad`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:53.445657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c24cc7f5-dfc6-4f9b-beb5-1d561e735849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:53.485454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:53.520771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 686/1395] 10.222.0.77 () {58 vars in 1063 bytes} [Mon Aug 1 15:50:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:53.528228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06654928-7b29-4d9c-915b-a8b6f5067f48 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:53.529765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-06654928-7b29-4d9c-915b-a8b6f5067f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:53.543228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:53.638300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06654928-7b29-4d9c-915b-a8b6f5067f48 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:53.724086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf210e54-4b45-4671-a82a-6c5a7daecd85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:53.724588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210e54-4b45-4671-a82a-6c5a7daecd85 service glance] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:53.724865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210e54-4b45-4671-a82a-6c5a7daecd85 service glance] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:53.725136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210e54-4b45-4671-a82a-6c5a7daecd85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:53.726766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cf210e54-4b45-4671-a82a-6c5a7daecd85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:53.797222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:53.841373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210e54-4b45-4671-a82a-6c5a7daecd85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:53.842883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210e54-4b45-4671-a82a-6c5a7daecd85 service glance] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:53.861202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 710/1396] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:54.104363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035790e-cd4d-45bf-be4a-6c1a904d5d87 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:54.104651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035790e-cd4d-45bf-be4a-6c1a904d5d87 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:54.104929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035790e-cd4d-45bf-be4a-6c1a904d5d87 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:54.106407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 687/1397] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:54.113315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73db17-db95-4ae9-b790-55ee564ddeb8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:54.113938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73db17-db95-4ae9-b790-55ee564ddeb8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:54.113938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73db17-db95-4ae9-b790-55ee564ddeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:54.186647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0f73db17-db95-4ae9-b790-55ee564ddeb8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:54.188464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0f73db17-db95-4ae9-b790-55ee564ddeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:54.293577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 711/1398] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:54.342999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035790e-cd4d-45bf-be4a-6c1a904d5d87 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:54.344488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c035790e-cd4d-45bf-be4a-6c1a904d5d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:54.493773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035790e-cd4d-45bf-be4a-6c1a904d5d87 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:54.548409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:54.616196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a6e3-1573-46bc-b3d7-6a9d2d7c5190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:54.616926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a6e3-1573-46bc-b3d7-6a9d2d7c5190 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:54.617209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a6e3-1573-46bc-b3d7-6a9d2d7c5190 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:54.617484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a6e3-1573-46bc-b3d7-6a9d2d7c5190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:54.619246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9b91a6e3-1573-46bc-b3d7-6a9d2d7c5190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:54.705257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f51c1-e1b1-45ec-a47b-3c1e6a908b03 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:54.705580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f51c1-e1b1-45ec-a47b-3c1e6a908b03 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:54.705866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f51c1-e1b1-45ec-a47b-3c1e6a908b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:54.713373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91a6e3-1573-46bc-b3d7-6a9d2d7c5190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:54.715009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91a6e3-1573-46bc-b3d7-6a9d2d7c5190 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:54.732294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:54.734190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 688/1399] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:54.771684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-118f51c1-e1b1-45ec-a47b-3c1e6a908b03 None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:54.772883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-118f51c1-e1b1-45ec-a47b-3c1e6a908b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:54.870658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 712/1400] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:50:54.918568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf87cd-661c-43bd-b8b2-58a96ea954b2 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:54.918865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf87cd-661c-43bd-b8b2-58a96ea954b2 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:54.919153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf87cd-661c-43bd-b8b2-58a96ea954b2 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:54.920512 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 689/1401] 10.222.0.77 () {54 vars in 943 bytes} [Mon Aug 1 15:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:54.927151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafce02e-2290-467d-ae32-8f62d1a6d163 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:54.927448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafce02e-2290-467d-ae32-8f62d1a6d163 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:54.927733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafce02e-2290-467d-ae32-8f62d1a6d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:55.021675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-bafce02e-2290-467d-ae32-8f62d1a6d163 None None] MFA Rules not processed for user `159e2784eaf44126b4e04dacbb328add`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:55.022959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bafce02e-2290-467d-ae32-8f62d1a6d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:55.080925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:55.135113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 713/1402] 10.222.0.77 () {58 vars in 1040 bytes} [Mon Aug 1 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:55.145075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf87cd-661c-43bd-b8b2-58a96ea954b2 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:55.146684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-94cf87cd-661c-43bd-b8b2-58a96ea954b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:55.205916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:55.287912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf87cd-661c-43bd-b8b2-58a96ea954b2 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:55.402957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5992bf-6329-4f99-aed3-4d593ed33f86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:55.403657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5992bf-6329-4f99-aed3-4d593ed33f86 service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:55.403815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5992bf-6329-4f99-aed3-4d593ed33f86 service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:55.404124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5992bf-6329-4f99-aed3-4d593ed33f86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:55.405871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2f5992bf-6329-4f99-aed3-4d593ed33f86 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:55.447503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:55.492973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5992bf-6329-4f99-aed3-4d593ed33f86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:55.494604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5992bf-6329-4f99-aed3-4d593ed33f86 service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:55.503463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 690/1403] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 15:50:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:50:56.945010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65debf48-e1b8-4df8-9f4c-0a6e278a0e60 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:56.945588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65debf48-e1b8-4df8-9f4c-0a6e278a0e60 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:56.945704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65debf48-e1b8-4df8-9f4c-0a6e278a0e60 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:56.948459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 714/1404] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:50:56.953839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa055-9693-4fd4-89d5-19a252eb766a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:56.954584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa055-9693-4fd4-89d5-19a252eb766a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:56.954584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa055-9693-4fd4-89d5-19a252eb766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:57.040133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8c4aa055-9693-4fd4-89d5-19a252eb766a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:57.041386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8c4aa055-9693-4fd4-89d5-19a252eb766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:57.287089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 691/1405] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:50:57.337141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65debf48-e1b8-4df8-9f4c-0a6e278a0e60 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:57.338749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-65debf48-e1b8-4df8-9f4c-0a6e278a0e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:57.519406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65debf48-e1b8-4df8-9f4c-0a6e278a0e60 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:57.554167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:57.662765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afd76d-1118-4911-92e1-192a57398037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:57.663740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afd76d-1118-4911-92e1-192a57398037 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:57.664274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afd76d-1118-4911-92e1-192a57398037 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:57.664670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afd76d-1118-4911-92e1-192a57398037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:57.670162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-35afd76d-1118-4911-92e1-192a57398037 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:57.783952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afd76d-1118-4911-92e1-192a57398037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:57.785598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afd76d-1118-4911-92e1-192a57398037 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:57.805446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 715/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:00.064210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e3cf6-b329-4865-90e6-18ab883a965d None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:00.064797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e3cf6-b329-4865-90e6-18ab883a965d None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:00.065251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e3cf6-b329-4865-90e6-18ab883a965d None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:00.067718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 692/1407] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:51:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:00.077486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551003-4761-4083-8c84-2be3063c062a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:00.078848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551003-4761-4083-8c84-2be3063c062a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:00.079392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551003-4761-4083-8c84-2be3063c062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:00.130614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:00.158689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ed551003-4761-4083-8c84-2be3063c062a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:00.160486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ed551003-4761-4083-8c84-2be3063c062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:00.277676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 716/1408] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:00.324522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e3cf6-b329-4865-90e6-18ab883a965d None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:00.326064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-853e3cf6-b329-4865-90e6-18ab883a965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:00.364549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:00.505157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e3cf6-b329-4865-90e6-18ab883a965d None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:00.614257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:00.627821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d90a1-6006-4565-b9ab-4906fc865f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:00.630809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d90a1-6006-4565-b9ab-4906fc865f13 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:00.630809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d90a1-6006-4565-b9ab-4906fc865f13 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:00.630809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d90a1-6006-4565-b9ab-4906fc865f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:00.630809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f20d90a1-6006-4565-b9ab-4906fc865f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:00.737911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d90a1-6006-4565-b9ab-4906fc865f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:00.739527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d90a1-6006-4565-b9ab-4906fc865f13 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:00.766963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 693/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:10.272767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=51 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:10.763533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=49 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:19.354159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4ed78-45ce-4054-82fd-8b0d803c98c2 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:19.354727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4ed78-45ce-4054-82fd-8b0d803c98c2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:19.354727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4ed78-45ce-4054-82fd-8b0d803c98c2 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:19.356100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 717/1410] 10.222.0.77 () {54 vars in 918 bytes} [Mon Aug 1 15:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:51:19.361762 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b900-b61e-444e-96eb-13e19771785a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:19.362229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b900-b61e-444e-96eb-13e19771785a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:19.362340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b900-b61e-444e-96eb-13e19771785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:19.458960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-5445b900-b61e-444e-96eb-13e19771785a None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:19.460803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5445b900-b61e-444e-96eb-13e19771785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:19.569117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 694/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 1 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:19.583489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf28c63-5e51-4ae7-936e-c111c8317c6c None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:19.583782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf28c63-5e51-4ae7-936e-c111c8317c6c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:19.584108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf28c63-5e51-4ae7-936e-c111c8317c6c None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:19.585457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 718/1412] 10.222.0.77 () {54 vars in 918 bytes} [Mon Aug 1 15:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:19.590327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191019-e8e1-4148-80db-88f9917454f7 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:19.590621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191019-e8e1-4148-80db-88f9917454f7 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:19.590897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191019-e8e1-4148-80db-88f9917454f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:19.666720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:19.669825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-cd191019-e8e1-4148-80db-88f9917454f7 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:19.671040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cd191019-e8e1-4148-80db-88f9917454f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:19.790085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 695/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 1 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:22.365979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032494e-eb58-472d-8a66-36e0181f42fc None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:22.366559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032494e-eb58-472d-8a66-36e0181f42fc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:22.366559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032494e-eb58-472d-8a66-36e0181f42fc None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:22.367958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:22.373320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db419e7-7583-46e3-bfe7-cde3d725d81d None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:22.373800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db419e7-7583-46e3-bfe7-cde3d725d81d None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:22.374104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db419e7-7583-46e3-bfe7-cde3d725d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:22.450859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0db419e7-7583-46e3-bfe7-cde3d725d81d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:22.452081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0db419e7-7583-46e3-bfe7-cde3d725d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:22.517536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:22.562848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:22.608948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032494e-eb58-472d-8a66-36e0181f42fc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:22.610498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4032494e-eb58-472d-8a66-36e0181f42fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:22.767834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032494e-eb58-472d-8a66-36e0181f42fc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:22.843053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:22.884776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8680e-4013-4fe9-8e78-c5c129517342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:22.885394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8680e-4013-4fe9-8e78-c5c129517342 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:22.885708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8680e-4013-4fe9-8e78-c5c129517342 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:22.886033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8680e-4013-4fe9-8e78-c5c129517342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:22.887771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b9c8680e-4013-4fe9-8e78-c5c129517342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:22.978672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8680e-4013-4fe9-8e78-c5c129517342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:22.980369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8680e-4013-4fe9-8e78-c5c129517342 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:22.998548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 720/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:23.911889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ed9b3-49cb-4b65-ad8a-6189f3fb5fb0 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:23.912578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ed9b3-49cb-4b65-ad8a-6189f3fb5fb0 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:23.912578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ed9b3-49cb-4b65-ad8a-6189f3fb5fb0 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:23.915569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:23.920343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789f4d4-155b-42a7-a49c-087ff988847a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:23.920824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789f4d4-155b-42a7-a49c-087ff988847a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:23.920943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789f4d4-155b-42a7-a49c-087ff988847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:24.000612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7789f4d4-155b-42a7-a49c-087ff988847a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:24.001926 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7789f4d4-155b-42a7-a49c-087ff988847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:24.028387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:24.098491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:24.258622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ed9b3-49cb-4b65-ad8a-6189f3fb5fb0 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:24.260246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4d2ed9b3-49cb-4b65-ad8a-6189f3fb5fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:24.413626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ed9b3-49cb-4b65-ad8a-6189f3fb5fb0 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:24.453423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:24.524598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec85b90-c707-4a17-b4b9-07e0a7d17d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:24.525145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85b90-c707-4a17-b4b9-07e0a7d17d21 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:24.525427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85b90-c707-4a17-b4b9-07e0a7d17d21 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:24.525841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85b90-c707-4a17-b4b9-07e0a7d17d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:24.527451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9ec85b90-c707-4a17-b4b9-07e0a7d17d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:24.618608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec85b90-c707-4a17-b4b9-07e0a7d17d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:24.620560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec85b90-c707-4a17-b4b9-07e0a7d17d21 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:24.644061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 698/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:25.537209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4083-21be-4d80-a328-1a1c6f3b27d6 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:25.537885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4083-21be-4d80-a328-1a1c6f3b27d6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:25.537885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4083-21be-4d80-a328-1a1c6f3b27d6 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:25.539215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:25.544139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9402-5dc3-4ec1-bb76-733c60b5be78 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:25.544558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9402-5dc3-4ec1-bb76-733c60b5be78 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:25.544682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9402-5dc3-4ec1-bb76-733c60b5be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:25.603821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:25.631395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-835b9402-5dc3-4ec1-bb76-733c60b5be78 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:25.633714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-835b9402-5dc3-4ec1-bb76-733c60b5be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:25.734007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:25.890840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4083-21be-4d80-a328-1a1c6f3b27d6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:25.891452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2acd4083-21be-4d80-a328-1a1c6f3b27d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:26.040242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4083-21be-4d80-a328-1a1c6f3b27d6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:26.053414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:26.153322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487206c-3864-45aa-8594-e13c97b0bf52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:26.153882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487206c-3864-45aa-8594-e13c97b0bf52 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:26.154174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487206c-3864-45aa-8594-e13c97b0bf52 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:26.154458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487206c-3864-45aa-8594-e13c97b0bf52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:26.156126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c487206c-3864-45aa-8594-e13c97b0bf52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:26.257639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487206c-3864-45aa-8594-e13c97b0bf52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:26.259286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487206c-3864-45aa-8594-e13c97b0bf52 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:26.280602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 723/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:27.158358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89235f99-30f8-4c20-a80b-6f8166d58615 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:27.158904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89235f99-30f8-4c20-a80b-6f8166d58615 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:27.159017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89235f99-30f8-4c20-a80b-6f8166d58615 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:27.160985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:27.166489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6fa73-0b32-4cad-8137-2e94fbaa0ff5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:27.166976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6fa73-0b32-4cad-8137-2e94fbaa0ff5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:27.167071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6fa73-0b32-4cad-8137-2e94fbaa0ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:27.188955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:27.253016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-15c6fa73-0b32-4cad-8137-2e94fbaa0ff5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:27.254477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-15c6fa73-0b32-4cad-8137-2e94fbaa0ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:27.362458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:51:27.516160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89235f99-30f8-4c20-a80b-6f8166d58615 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:27.517725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-89235f99-30f8-4c20-a80b-6f8166d58615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:27.627561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:27.664374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89235f99-30f8-4c20-a80b-6f8166d58615 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:27.785967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d776-9c27-49e4-b9b1-278db98be142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:27.785967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d776-9c27-49e4-b9b1-278db98be142 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:27.785967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d776-9c27-49e4-b9b1-278db98be142 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:27.785967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d776-9c27-49e4-b9b1-278db98be142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:27.786445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6de0d776-9c27-49e4-b9b1-278db98be142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:27.855948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:27.869155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d776-9c27-49e4-b9b1-278db98be142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:27.871738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d776-9c27-49e4-b9b1-278db98be142 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:27.888672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 701/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:51:28.792624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67010513-cc9f-4186-a83a-5ec015a1eb82 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:28.793302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67010513-cc9f-4186-a83a-5ec015a1eb82 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:28.793302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67010513-cc9f-4186-a83a-5ec015a1eb82 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:28.794590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:28.800023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ef79b-67b0-4781-8392-5249ec9c2dce None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:28.800471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ef79b-67b0-4781-8392-5249ec9c2dce None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:28.800569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ef79b-67b0-4781-8392-5249ec9c2dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:28.876802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-030ef79b-67b0-4781-8392-5249ec9c2dce None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:28.878049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-030ef79b-67b0-4781-8392-5249ec9c2dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:28.974055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:29.145242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67010513-cc9f-4186-a83a-5ec015a1eb82 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:29.145242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-67010513-cc9f-4186-a83a-5ec015a1eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:29.223969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:29.298737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67010513-cc9f-4186-a83a-5ec015a1eb82 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:29.437128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766a94f-7246-4b52-a3b1-227e255f9352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:29.437705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766a94f-7246-4b52-a3b1-227e255f9352 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:29.437994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766a94f-7246-4b52-a3b1-227e255f9352 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:29.438275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766a94f-7246-4b52-a3b1-227e255f9352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:29.440472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2766a94f-7246-4b52-a3b1-227e255f9352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:29.490885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:29.540517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766a94f-7246-4b52-a3b1-227e255f9352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:29.542243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766a94f-7246-4b52-a3b1-227e255f9352 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:29.564808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 726/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:30.443844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090714-df30-488e-bfab-0e0685f50e82 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:30.444426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090714-df30-488e-bfab-0e0685f50e82 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:30.444426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090714-df30-488e-bfab-0e0685f50e82 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:30.445734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:30.450895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b44f6a-416c-41cd-9841-7d36770f08ac None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:30.451369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b44f6a-416c-41cd-9841-7d36770f08ac None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:30.451473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b44f6a-416c-41cd-9841-7d36770f08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:30.537541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-93b44f6a-416c-41cd-9841-7d36770f08ac None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:30.538806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-93b44f6a-416c-41cd-9841-7d36770f08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:30.639722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:30.792063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090714-df30-488e-bfab-0e0685f50e82 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:30.793698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cf090714-df30-488e-bfab-0e0685f50e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:30.844010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:30.948890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090714-df30-488e-bfab-0e0685f50e82 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:31.064724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb5c22-2d7b-40a5-b113-7dc269fa43b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:31.065267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5c22-2d7b-40a5-b113-7dc269fa43b4 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:31.065575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5c22-2d7b-40a5-b113-7dc269fa43b4 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:31.065850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5c22-2d7b-40a5-b113-7dc269fa43b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:31.067484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b2cb5c22-2d7b-40a5-b113-7dc269fa43b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:31.074759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:31.163163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb5c22-2d7b-40a5-b113-7dc269fa43b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:31.164792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb5c22-2d7b-40a5-b113-7dc269fa43b4 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:31.185908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 704/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:51:32.065385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b51fc-ac5e-43b9-a7a2-86efbf753d78 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:32.065959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b51fc-ac5e-43b9-a7a2-86efbf753d78 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:32.065959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b51fc-ac5e-43b9-a7a2-86efbf753d78 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:32.067371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:51:32.072382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd875df1-c5e6-482b-bd30-ab8b84b0a109 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:32.072803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd875df1-c5e6-482b-bd30-ab8b84b0a109 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:32.072949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd875df1-c5e6-482b-bd30-ab8b84b0a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:32.148288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-cd875df1-c5e6-482b-bd30-ab8b84b0a109 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:32.149496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cd875df1-c5e6-482b-bd30-ab8b84b0a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:32.219760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:32.250099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:32.402460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b51fc-ac5e-43b9-a7a2-86efbf753d78 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:32.404099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-270b51fc-ac5e-43b9-a7a2-86efbf753d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:32.421427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:32.569752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b51fc-ac5e-43b9-a7a2-86efbf753d78 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:32.666778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:32.695113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72553840-8391-426a-8893-48156c24b531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:32.695723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72553840-8391-426a-8893-48156c24b531 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:32.696008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72553840-8391-426a-8893-48156c24b531 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:32.696282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72553840-8391-426a-8893-48156c24b531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:32.697949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-72553840-8391-426a-8893-48156c24b531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:32.790493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72553840-8391-426a-8893-48156c24b531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:32.792113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72553840-8391-426a-8893-48156c24b531 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:32.810263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 729/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:33.663931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754aa5-5c9c-45c9-89f7-333ba0cebf2d None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:33.664450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754aa5-5c9c-45c9-89f7-333ba0cebf2d None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:33.664450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754aa5-5c9c-45c9-89f7-333ba0cebf2d None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:33.665779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:33.670845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa8fb6-fff9-4d7c-9958-1f701ebf3a4e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:33.671237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa8fb6-fff9-4d7c-9958-1f701ebf3a4e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:33.671403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa8fb6-fff9-4d7c-9958-1f701ebf3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:33.759712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b8aa8fb6-fff9-4d7c-9958-1f701ebf3a4e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:33.760932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b8aa8fb6-fff9-4d7c-9958-1f701ebf3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:33.813967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:33.871567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:34.024024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d754aa5-5c9c-45c9-89f7-333ba0cebf2d None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:34.025542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5d754aa5-5c9c-45c9-89f7-333ba0cebf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:34.177886 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d754aa5-5c9c-45c9-89f7-333ba0cebf2d None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:34.238100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:34.312912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04574b9-94bf-4b50-92a1-ac50f6a4b96b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:34.314271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04574b9-94bf-4b50-92a1-ac50f6a4b96b service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:34.314679 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04574b9-94bf-4b50-92a1-ac50f6a4b96b service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:34.315044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04574b9-94bf-4b50-92a1-ac50f6a4b96b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:34.317034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a04574b9-94bf-4b50-92a1-ac50f6a4b96b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:34.418138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04574b9-94bf-4b50-92a1-ac50f6a4b96b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:34.419745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04574b9-94bf-4b50-92a1-ac50f6a4b96b service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:34.439094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 707/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:35.338825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4914c4-27c0-47b5-9d35-8d80e95c2468 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:35.339403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4914c4-27c0-47b5-9d35-8d80e95c2468 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:35.339403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4914c4-27c0-47b5-9d35-8d80e95c2468 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:35.340746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:35.346971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab043b-8731-48f8-b09c-b56d60826827 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:35.347578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab043b-8731-48f8-b09c-b56d60826827 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:35.347578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab043b-8731-48f8-b09c-b56d60826827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:35.432306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8bab043b-8731-48f8-b09c-b56d60826827 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:35.433559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8bab043b-8731-48f8-b09c-b56d60826827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:35.436140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:35.538598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:35.694250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4914c4-27c0-47b5-9d35-8d80e95c2468 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:35.695743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9f4914c4-27c0-47b5-9d35-8d80e95c2468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:35.854136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4914c4-27c0-47b5-9d35-8d80e95c2468 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:35.883661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:35.979030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1cabf-933b-49db-9dad-e48e738febd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:35.979656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1cabf-933b-49db-9dad-e48e738febd1 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:35.979935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1cabf-933b-49db-9dad-e48e738febd1 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:35.980211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1cabf-933b-49db-9dad-e48e738febd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:35.981891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-52e1cabf-933b-49db-9dad-e48e738febd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:36.092448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1cabf-933b-49db-9dad-e48e738febd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:36.094152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1cabf-933b-49db-9dad-e48e738febd1 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:36.115231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 732/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:38.084568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54947dd-3dfd-4d62-a12a-d0eb9063b126 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:38.085370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54947dd-3dfd-4d62-a12a-d0eb9063b126 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:38.085370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54947dd-3dfd-4d62-a12a-d0eb9063b126 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:38.087580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:38.094843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641b3-de52-456d-b6a8-3a99a5884ab6 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:38.095376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641b3-de52-456d-b6a8-3a99a5884ab6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:38.095376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641b3-de52-456d-b6a8-3a99a5884ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:38.150709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:38.181984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d08641b3-de52-456d-b6a8-3a99a5884ab6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:38.183941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d08641b3-de52-456d-b6a8-3a99a5884ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:38.296788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:38.338804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54947dd-3dfd-4d62-a12a-d0eb9063b126 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:38.344290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c54947dd-3dfd-4d62-a12a-d0eb9063b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:38.460111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54947dd-3dfd-4d62-a12a-d0eb9063b126 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:38.500091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:38.555317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e87356-9534-4dcd-a118-b6254a57e134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:38.555947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e87356-9534-4dcd-a118-b6254a57e134 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:38.556231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e87356-9534-4dcd-a118-b6254a57e134 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:38.556510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e87356-9534-4dcd-a118-b6254a57e134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:38.558181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c6e87356-9534-4dcd-a118-b6254a57e134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:38.680790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e87356-9534-4dcd-a118-b6254a57e134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:38.682297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e87356-9534-4dcd-a118-b6254a57e134 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:38.703122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 710/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:41.031983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41c8f-6591-409c-b23a-1600bf34d622 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:41.032558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41c8f-6591-409c-b23a-1600bf34d622 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:41.032558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41c8f-6591-409c-b23a-1600bf34d622 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:41.034012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:41.039124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03858a3-1fd4-439c-b921-5328ca45034a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:41.039578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03858a3-1fd4-439c-b921-5328ca45034a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:41.039716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03858a3-1fd4-439c-b921-5328ca45034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:41.104325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f03858a3-1fd4-439c-b921-5328ca45034a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:41.105543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f03858a3-1fd4-439c-b921-5328ca45034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:41.118420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:41.201783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:41.241210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41c8f-6591-409c-b23a-1600bf34d622 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:41.242771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-07c41c8f-6591-409c-b23a-1600bf34d622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:41.346376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41c8f-6591-409c-b23a-1600bf34d622 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:41.358336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:41.420349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512432-2934-4828-9d8a-de4f69dc66e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:41.420969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512432-2934-4828-9d8a-de4f69dc66e7 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:41.421256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512432-2934-4828-9d8a-de4f69dc66e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:41.421563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512432-2934-4828-9d8a-de4f69dc66e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:41.423713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-70512432-2934-4828-9d8a-de4f69dc66e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:41.532358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512432-2934-4828-9d8a-de4f69dc66e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:41.533832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512432-2934-4828-9d8a-de4f69dc66e7 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:41.553674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 735/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:43.953487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0603-8c37-405b-ae95-a75c1e44d94e None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:43.954092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0603-8c37-405b-ae95-a75c1e44d94e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:43.954092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0603-8c37-405b-ae95-a75c1e44d94e None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:43.955507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:43.961087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927eb48-6800-466c-9b83-7d1865cc43a2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:43.961548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927eb48-6800-466c-9b83-7d1865cc43a2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:43.961671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927eb48-6800-466c-9b83-7d1865cc43a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:44.008831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:44.026448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b927eb48-6800-466c-9b83-7d1865cc43a2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:44.027669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b927eb48-6800-466c-9b83-7d1865cc43a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:44.134084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:44.174632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0603-8c37-405b-ae95-a75c1e44d94e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:44.176097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-447d0603-8c37-405b-ae95-a75c1e44d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:44.278560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0603-8c37-405b-ae95-a75c1e44d94e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:44.320696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:44.355347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b0b7-db53-465a-aba2-466abbd19197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:44.355969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b0b7-db53-465a-aba2-466abbd19197 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:44.356252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b0b7-db53-465a-aba2-466abbd19197 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:44.356529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b0b7-db53-465a-aba2-466abbd19197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:44.358179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8aa3b0b7-db53-465a-aba2-466abbd19197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:44.467718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b0b7-db53-465a-aba2-466abbd19197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:44.470058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b0b7-db53-465a-aba2-466abbd19197 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:44.488278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 713/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:46.621101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124401-b77c-4a10-a60d-c4f059e0d4bc None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:46.621636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124401-b77c-4a10-a60d-c4f059e0d4bc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:46.621636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124401-b77c-4a10-a60d-c4f059e0d4bc None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:46.622987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:46.629308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266df4-eb0c-4f6c-8bed-4a5fd9950d60 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:46.629746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266df4-eb0c-4f6c-8bed-4a5fd9950d60 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:46.629930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266df4-eb0c-4f6c-8bed-4a5fd9950d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:46.697160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8b266df4-eb0c-4f6c-8bed-4a5fd9950d60 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:46.698394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8b266df4-eb0c-4f6c-8bed-4a5fd9950d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:46.718391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:46.792290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:46.831687 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf124401-b77c-4a10-a60d-c4f059e0d4bc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:46.833212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bf124401-b77c-4a10-a60d-c4f059e0d4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:46.938822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf124401-b77c-4a10-a60d-c4f059e0d4bc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:46.959101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:47.012564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af6930-c8a3-4d1a-afc5-e9c9d7e10733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:47.013211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6930-c8a3-4d1a-afc5-e9c9d7e10733 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:47.013501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6930-c8a3-4d1a-afc5-e9c9d7e10733 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:47.013808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6930-c8a3-4d1a-afc5-e9c9d7e10733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:47.015449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d7af6930-c8a3-4d1a-afc5-e9c9d7e10733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:47.127689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6930-c8a3-4d1a-afc5-e9c9d7e10733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:47.129261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6930-c8a3-4d1a-afc5-e9c9d7e10733 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:47.148152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 738/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:49.268054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ad232-0516-4c29-a191-1110ee3620d1 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:49.268647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ad232-0516-4c29-a191-1110ee3620d1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:49.268647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ad232-0516-4c29-a191-1110ee3620d1 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:49.270008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:49.275187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e838cb3-b230-4895-a09a-3752bf953345 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:49.275630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e838cb3-b230-4895-a09a-3752bf953345 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:49.275769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e838cb3-b230-4895-a09a-3752bf953345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:49.341291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:49.344103 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1e838cb3-b230-4895-a09a-3752bf953345 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:49.345358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1e838cb3-b230-4895-a09a-3752bf953345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:49.441063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:49.479685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ad232-0516-4c29-a191-1110ee3620d1 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:49.481215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-250ad232-0516-4c29-a191-1110ee3620d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:49.584002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ad232-0516-4c29-a191-1110ee3620d1 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:49.632835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:49.661294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac566429-a6e5-4070-ad47-81d0f26c1a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:49.661938 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566429-a6e5-4070-ad47-81d0f26c1a4b service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:49.662226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566429-a6e5-4070-ad47-81d0f26c1a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:49.662502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566429-a6e5-4070-ad47-81d0f26c1a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:49.664114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ac566429-a6e5-4070-ad47-81d0f26c1a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:49.782800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac566429-a6e5-4070-ad47-81d0f26c1a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:49.784239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac566429-a6e5-4070-ad47-81d0f26c1a4b service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:49.803200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 716/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:51.871512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048997a-46ab-42f5-a726-ba8358cd3ee4 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:51.872115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048997a-46ab-42f5-a726-ba8358cd3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:51.872115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048997a-46ab-42f5-a726-ba8358cd3ee4 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:51.873543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:51.879421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1581-4f4f-4bd5-a3c7-a7f7274169d8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:51.880042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1581-4f4f-4bd5-a3c7-a7f7274169d8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:51.880042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1581-4f4f-4bd5-a3c7-a7f7274169d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:51.955770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-204f1581-4f4f-4bd5-a3c7-a7f7274169d8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:51.957003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-204f1581-4f4f-4bd5-a3c7-a7f7274169d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:51.992312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:52.061312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:52.099267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048997a-46ab-42f5-a726-ba8358cd3ee4 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:52.100855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b048997a-46ab-42f5-a726-ba8358cd3ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:52.204064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048997a-46ab-42f5-a726-ba8358cd3ee4 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.234163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:52.282073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eeb4c2-06e3-442f-8bfd-933a2f623fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.282705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeb4c2-06e3-442f-8bfd-933a2f623fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.283013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeb4c2-06e3-442f-8bfd-933a2f623fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.283274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeb4c2-06e3-442f-8bfd-933a2f623fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.284911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c7eeb4c2-06e3-442f-8bfd-933a2f623fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:52.403337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eeb4c2-06e3-442f-8bfd-933a2f623fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.404906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eeb4c2-06e3-442f-8bfd-933a2f623fc4 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:52.430046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 741/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:54.495292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8f28-173f-453c-a3f1-686f343291c0 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:54.495855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8f28-173f-453c-a3f1-686f343291c0 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:54.495855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8f28-173f-453c-a3f1-686f343291c0 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:54.497203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:54.503049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f110-5ad4-404e-88a0-6fa10d56bbf6 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:54.503490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f110-5ad4-404e-88a0-6fa10d56bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:54.503636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f110-5ad4-404e-88a0-6fa10d56bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:54.579553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-aff0f110-5ad4-404e-88a0-6fa10d56bbf6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:54.580689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-aff0f110-5ad4-404e-88a0-6fa10d56bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:54.589203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:54.687822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:54.725331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a8f28-173f-453c-a3f1-686f343291c0 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:54.726924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b71a8f28-173f-453c-a3f1-686f343291c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:54.835132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a8f28-173f-453c-a3f1-686f343291c0 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:54.891554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:54.910327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969faa5-9df1-4777-abcb-772db5f16c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:54.920328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969faa5-9df1-4777-abcb-772db5f16c11 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:54.920328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969faa5-9df1-4777-abcb-772db5f16c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:54.920328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969faa5-9df1-4777-abcb-772db5f16c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:54.920328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4969faa5-9df1-4777-abcb-772db5f16c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:55.022983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969faa5-9df1-4777-abcb-772db5f16c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:55.024428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969faa5-9df1-4777-abcb-772db5f16c11 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:55.042068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 719/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:57.094375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e3354-6c51-433b-8191-d29a4417f86e None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.095242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e3354-6c51-433b-8191-d29a4417f86e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.095429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e3354-6c51-433b-8191-d29a4417f86e None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.097005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:57.102346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aa8db-12b1-40ae-8e51-76b4a5d4b6ee None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.102760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aa8db-12b1-40ae-8e51-76b4a5d4b6ee None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.102940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aa8db-12b1-40ae-8e51-76b4a5d4b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.167734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-822aa8db-12b1-40ae-8e51-76b4a5d4b6ee None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:57.168948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-822aa8db-12b1-40ae-8e51-76b4a5d4b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:57.208383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:57.266542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:57.304311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e3354-6c51-433b-8191-d29a4417f86e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:57.309398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-102e3354-6c51-433b-8191-d29a4417f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:57.408817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e3354-6c51-433b-8191-d29a4417f86e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:57.445692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:57.485860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdea92-8ad5-471f-9f73-96e8182d46cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:57.486479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdea92-8ad5-471f-9f73-96e8182d46cb service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.486763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdea92-8ad5-471f-9f73-96e8182d46cb service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.487067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdea92-8ad5-471f-9f73-96e8182d46cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.488714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-36cdea92-8ad5-471f-9f73-96e8182d46cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:57.595408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdea92-8ad5-471f-9f73-96e8182d46cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:57.596865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdea92-8ad5-471f-9f73-96e8182d46cb service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:57.615490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 744/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:59.639530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a733c-4af5-42b4-b736-e32f1c21ec0e None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:59.640136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a733c-4af5-42b4-b736-e32f1c21ec0e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:59.640136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a733c-4af5-42b4-b736-e32f1c21ec0e None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:59.641727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:51:59.647074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7c991-45cf-48d8-a262-dd34ae5effdd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:59.647508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7c991-45cf-48d8-a262-dd34ae5effdd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:59.647628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7c991-45cf-48d8-a262-dd34ae5effdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:59.713736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3ee7c991-45cf-48d8-a262-dd34ae5effdd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:59.714945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3ee7c991-45cf-48d8-a262-dd34ae5effdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:59.732286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:59.809871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:59.846609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a733c-4af5-42b4-b736-e32f1c21ec0e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:59.848115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1c8a733c-4af5-42b4-b736-e32f1c21ec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:59.960047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a733c-4af5-42b4-b736-e32f1c21ec0e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:00.027860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:00.034856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb0443-a304-4f65-809c-0c0ae1782cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:00.035470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0443-a304-4f65-809c-0c0ae1782cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:00.035753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0443-a304-4f65-809c-0c0ae1782cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:00.036025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0443-a304-4f65-809c-0c0ae1782cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:00.037668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c5cb0443-a304-4f65-809c-0c0ae1782cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:00.148893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb0443-a304-4f65-809c-0c0ae1782cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:00.150456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb0443-a304-4f65-809c-0c0ae1782cc6 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:00.171769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 722/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:02.190450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860af2c-ed01-4714-bf1b-cc646decc686 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:02.191009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860af2c-ed01-4714-bf1b-cc646decc686 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:02.191009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860af2c-ed01-4714-bf1b-cc646decc686 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:02.192305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:02.197771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a316ce-cdcd-4b66-8441-3823ab49b053 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:02.198198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a316ce-cdcd-4b66-8441-3823ab49b053 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:02.198350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a316ce-cdcd-4b66-8441-3823ab49b053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:02.263651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-86a316ce-cdcd-4b66-8441-3823ab49b053 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:02.264879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-86a316ce-cdcd-4b66-8441-3823ab49b053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:02.314271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:02.362537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:02.399748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860af2c-ed01-4714-bf1b-cc646decc686 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:02.401403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5860af2c-ed01-4714-bf1b-cc646decc686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:02.620777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860af2c-ed01-4714-bf1b-cc646decc686 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:02.668165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:02.694382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc9ea1-adf7-4886-82a3-ed0a47496460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:02.694993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc9ea1-adf7-4886-82a3-ed0a47496460 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:02.695278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc9ea1-adf7-4886-82a3-ed0a47496460 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:02.695554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc9ea1-adf7-4886-82a3-ed0a47496460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:02.697151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8ffc9ea1-adf7-4886-82a3-ed0a47496460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:02.805645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc9ea1-adf7-4886-82a3-ed0a47496460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:02.807096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc9ea1-adf7-4886-82a3-ed0a47496460 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:02.825338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 747/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:12.360713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=22 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:12.823095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=66 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:22.592356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bab6c-76fc-4770-869a-aa137aacc4fb None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:22.592931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bab6c-76fc-4770-869a-aa137aacc4fb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:22.592931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bab6c-76fc-4770-869a-aa137aacc4fb None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:22.594314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 724/1471] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:52:22.599732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c5ef-90c1-44b2-b4e6-ac6fb7e9fc1b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:22.600190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c5ef-90c1-44b2-b4e6-ac6fb7e9fc1b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:22.600318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c5ef-90c1-44b2-b4e6-ac6fb7e9fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:22.668809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-93f5c5ef-90c1-44b2-b4e6-ac6fb7e9fc1b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:22.670631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-93f5c5ef-90c1-44b2-b4e6-ac6fb7e9fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:22.767283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 748/1472] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:22.853492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d133-b333-457b-8411-6f9b50ed8b0c None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:22.853815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d133-b333-457b-8411-6f9b50ed8b0c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:22.854103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d133-b333-457b-8411-6f9b50ed8b0c None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:22.855448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 725/1473] 10.222.0.77 () {54 vars in 966 bytes} [Mon Aug 1 15:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:22.861233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441941bc-3e2b-4b23-b0bd-29488d07d75d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:22.861534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441941bc-3e2b-4b23-b0bd-29488d07d75d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:22.861842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441941bc-3e2b-4b23-b0bd-29488d07d75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:22.944971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-441941bc-3e2b-4b23-b0bd-29488d07d75d None None] MFA Rules not processed for user `5048d76e4ffb4e12bb76ad3c8e5095ad`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:22.946222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-441941bc-3e2b-4b23-b0bd-29488d07d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:22.967942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:23.025286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 749/1474] 10.222.0.77 () {58 vars in 1063 bytes} [Mon Aug 1 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:23.035522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d133-b333-457b-8411-6f9b50ed8b0c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:23.037733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a9e1d133-b333-457b-8411-6f9b50ed8b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:23.155905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d133-b333-457b-8411-6f9b50ed8b0c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:23.232781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df645d30-0ddd-4e02-864d-e42bcf996e18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:23.233409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645d30-0ddd-4e02-864d-e42bcf996e18 service glance] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:23.233728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645d30-0ddd-4e02-864d-e42bcf996e18 service glance] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:23.234009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645d30-0ddd-4e02-864d-e42bcf996e18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:23.235649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-df645d30-0ddd-4e02-864d-e42bcf996e18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:23.291250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:23.349622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df645d30-0ddd-4e02-864d-e42bcf996e18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:23.351494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df645d30-0ddd-4e02-864d-e42bcf996e18 service glance] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:23.370960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 726/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:25.515678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd34338-4597-4273-9f84-368202c74ee8 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:25.516248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd34338-4597-4273-9f84-368202c74ee8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:25.516248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd34338-4597-4273-9f84-368202c74ee8 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:25.517621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 750/1476] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:25.523113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863a7cc-0024-4e06-91fd-702ec0417f7f None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:25.523928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863a7cc-0024-4e06-91fd-702ec0417f7f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:25.523928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863a7cc-0024-4e06-91fd-702ec0417f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:25.591990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7863a7cc-0024-4e06-91fd-702ec0417f7f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:25.593128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7863a7cc-0024-4e06-91fd-702ec0417f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:25.698528 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 727/1477] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:25.722101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd34338-4597-4273-9f84-368202c74ee8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:25.723646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-fdd34338-4597-4273-9f84-368202c74ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:25.854626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd34338-4597-4273-9f84-368202c74ee8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:25.906366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:25.952503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5815-9438-4636-99ab-cd26229b7bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:25.953232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5815-9438-4636-99ab-cd26229b7bae admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:25.953534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5815-9438-4636-99ab-cd26229b7bae admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:25.953914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5815-9438-4636-99ab-cd26229b7bae admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:25.954556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5815-9438-4636-99ab-cd26229b7bae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:25.956315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-e45f5815-9438-4636-99ab-cd26229b7bae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:52:25.956315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:52:25.956315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:52:25.957462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5815-9438-4636-99ab-cd26229b7bae admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:25.977637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 751/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 1 15:52:25 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:52:28.040700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e1e1-cc25-4f4d-b3ee-53b537b741d8 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:28.041232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e1e1-cc25-4f4d-b3ee-53b537b741d8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:28.041232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e1e1-cc25-4f4d-b3ee-53b537b741d8 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:28.042652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 728/1479] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:28.048565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74d4-f3f2-4385-b3d2-d24baa2ee866 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:28.049028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74d4-f3f2-4385-b3d2-d24baa2ee866 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:28.049126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74d4-f3f2-4385-b3d2-d24baa2ee866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:28.114264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-975e74d4-f3f2-4385-b3d2-d24baa2ee866 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:28.115469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-975e74d4-f3f2-4385-b3d2-d24baa2ee866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:28.212293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 752/1480] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:28.257897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e1e1-cc25-4f4d-b3ee-53b537b741d8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:28.260583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3bc4e1e1-cc25-4f4d-b3ee-53b537b741d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:28.270944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:28.423466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e1e1-cc25-4f4d-b3ee-53b537b741d8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:28.507875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:28.543136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5df71-0b8f-4674-8056-8d94bcd5341e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:28.543767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5df71-0b8f-4674-8056-8d94bcd5341e service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:28.544049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5df71-0b8f-4674-8056-8d94bcd5341e service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:28.544325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5df71-0b8f-4674-8056-8d94bcd5341e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:28.546178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-12e5df71-0b8f-4674-8056-8d94bcd5341e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:28.640553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5df71-0b8f-4674-8056-8d94bcd5341e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:28.642200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5df71-0b8f-4674-8056-8d94bcd5341e service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:28.664811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 729/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:30.908320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34142c-b196-471b-bb2f-3ab2fc0c776f None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:30.909038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34142c-b196-471b-bb2f-3ab2fc0c776f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:30.909038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34142c-b196-471b-bb2f-3ab2fc0c776f None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:30.910315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 753/1482] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:30.916001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544ca7-0c76-49bc-be37-fe23f1d86f1a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:30.916538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544ca7-0c76-49bc-be37-fe23f1d86f1a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:30.916538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544ca7-0c76-49bc-be37-fe23f1d86f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:30.989883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8f544ca7-0c76-49bc-be37-fe23f1d86f1a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:30.991148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8f544ca7-0c76-49bc-be37-fe23f1d86f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:31.040263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:31.093263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 730/1483] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:31.131857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34142c-b196-471b-bb2f-3ab2fc0c776f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:31.133401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ce34142c-b196-471b-bb2f-3ab2fc0c776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:31.157398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:31.237995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34142c-b196-471b-bb2f-3ab2fc0c776f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:31.316940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d013-2dcd-4f3e-8af5-9bfd4723477c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:31.317593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d013-2dcd-4f3e-8af5-9bfd4723477c service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:31.317878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d013-2dcd-4f3e-8af5-9bfd4723477c service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:31.318148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d013-2dcd-4f3e-8af5-9bfd4723477c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:31.319767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6d46d013-2dcd-4f3e-8af5-9bfd4723477c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:31.397010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:31.433170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d013-2dcd-4f3e-8af5-9bfd4723477c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:31.434932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d013-2dcd-4f3e-8af5-9bfd4723477c service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:31.456304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 754/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:33.539030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a8f3-1208-40d9-a576-c84f5d5856bd None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:33.539602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a8f3-1208-40d9-a576-c84f5d5856bd None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:33.539602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a8f3-1208-40d9-a576-c84f5d5856bd None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:33.540987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 731/1485] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:33.547235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc9b7-c904-4f48-901f-17620696835f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:33.547743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc9b7-c904-4f48-901f-17620696835f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:33.547743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc9b7-c904-4f48-901f-17620696835f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:33.615415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e32fc9b7-c904-4f48-901f-17620696835f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:33.616686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e32fc9b7-c904-4f48-901f-17620696835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:33.725245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 755/1486] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:33.764465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a8f3-1208-40d9-a576-c84f5d5856bd None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:33.766040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-94a5a8f3-1208-40d9-a576-c84f5d5856bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:33.867522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a8f3-1208-40d9-a576-c84f5d5856bd None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:33.942506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:33.944313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25af8f9-2af6-497f-8c14-bb8a30cb35d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:33.944942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25af8f9-2af6-497f-8c14-bb8a30cb35d6 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:33.945218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25af8f9-2af6-497f-8c14-bb8a30cb35d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:33.945487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25af8f9-2af6-497f-8c14-bb8a30cb35d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:33.947213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c25af8f9-2af6-497f-8c14-bb8a30cb35d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:34.055455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25af8f9-2af6-497f-8c14-bb8a30cb35d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:34.056894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25af8f9-2af6-497f-8c14-bb8a30cb35d6 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:34.075495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 732/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:36.279516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ef89-a7d8-4dfa-8ee5-f92849e711e6 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:36.280116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ef89-a7d8-4dfa-8ee5-f92849e711e6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:36.280116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ef89-a7d8-4dfa-8ee5-f92849e711e6 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:36.281793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 756/1488] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:36.287158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bfc5c-e8fd-4045-b70e-e788dbb22bed None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:36.287605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bfc5c-e8fd-4045-b70e-e788dbb22bed None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:36.287765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bfc5c-e8fd-4045-b70e-e788dbb22bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:36.359442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-859bfc5c-e8fd-4045-b70e-e788dbb22bed None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:36.360716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-859bfc5c-e8fd-4045-b70e-e788dbb22bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:36.416492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:36.463194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 733/1489] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:36.504095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ef89-a7d8-4dfa-8ee5-f92849e711e6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:36.505636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8a57ef89-a7d8-4dfa-8ee5-f92849e711e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:36.542344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:36.611119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ef89-a7d8-4dfa-8ee5-f92849e711e6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:36.689999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b017e1c-9671-4997-8264-c5150f961a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:36.690627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017e1c-9671-4997-8264-c5150f961a7e service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:36.690911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017e1c-9671-4997-8264-c5150f961a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:36.691186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017e1c-9671-4997-8264-c5150f961a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:36.692836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8b017e1c-9671-4997-8264-c5150f961a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:36.780876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:36.809400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b017e1c-9671-4997-8264-c5150f961a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:36.811362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b017e1c-9671-4997-8264-c5150f961a7e service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:36.830066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 757/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:39.354792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759ec5-e5fd-4577-afd1-435419367a10 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:39.355379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759ec5-e5fd-4577-afd1-435419367a10 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:39.355379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759ec5-e5fd-4577-afd1-435419367a10 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:39.356762 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 734/1491] 10.222.0.77 () {54 vars in 926 bytes} [Mon Aug 1 15:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:52:39.363803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4aa61-5287-45a1-9bbd-7a50071df7c4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:39.364263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4aa61-5287-45a1-9bbd-7a50071df7c4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:39.364374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4aa61-5287-45a1-9bbd-7a50071df7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:39.432308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-09f4aa61-5287-45a1-9bbd-7a50071df7c4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:39.433829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-09f4aa61-5287-45a1-9bbd-7a50071df7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:39.531603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 758/1492] 10.222.0.77 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:39.571320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759ec5-e5fd-4577-afd1-435419367a10 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:39.572859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e8759ec5-e5fd-4577-afd1-435419367a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:39.679716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759ec5-e5fd-4577-afd1-435419367a10 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:39.760105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ae57-ff06-4e85-8bd2-7f0d9784c1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:39.760721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ae57-ff06-4e85-8bd2-7f0d9784c1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:39.761002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ae57-ff06-4e85-8bd2-7f0d9784c1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:39.761278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ae57-ff06-4e85-8bd2-7f0d9784c1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:39.762990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1fc1ae57-ff06-4e85-8bd2-7f0d9784c1d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:39.772604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:39.875121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ae57-ff06-4e85-8bd2-7f0d9784c1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:39.876477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ae57-ff06-4e85-8bd2-7f0d9784c1d7 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:39.895810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 735/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:49.529794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=82 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:49.893353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=50 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:32.080839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab71aa4-ce1c-4b9e-a5cf-53b3a63837f8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.081391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab71aa4-ce1c-4b9e-a5cf-53b3a63837f8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.081391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab71aa4-ce1c-4b9e-a5cf-53b3a63837f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.168729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4ab71aa4-ce1c-4b9e-a5cf-53b3a63837f8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:32.169961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4ab71aa4-ce1c-4b9e-a5cf-53b3a63837f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:32.273543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 759/1494] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:32.281845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5361-5a32-4005-94d7-7c57adbfb585 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.282375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5361-5a32-4005-94d7-7c57adbfb585 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.282375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5361-5a32-4005-94d7-7c57adbfb585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.302447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-897f5361-5a32-4005-94d7-7c57adbfb585 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:32.303652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-897f5361-5a32-4005-94d7-7c57adbfb585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:32.312538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 736/1495] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:32.317110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab71aa4-ce1c-4b9e-a5cf-53b3a63837f8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.327305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab71aa4-ce1c-4b9e-a5cf-53b3a63837f8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.331824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.332451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.332733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.333009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.333731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:32.334036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.335731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:32.335731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:54:32.335731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:54:32.336603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.348041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 760/1496] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:32.356563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5361-5a32-4005-94d7-7c57adbfb585 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.366122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5361-5a32-4005-94d7-7c57adbfb585 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.371102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.371742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.372004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.372273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.372987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.374768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING py.warnings [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:32.374768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: warnings.warn(msg) Aug 01 15:54:32.374768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: Aug 01 15:54:32.375957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.540657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 737/1497] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:32.545190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.555608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a18a-44af-421e-b81b-3271ff8279ae admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.604201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:32.610730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.611342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.611628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.611905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.612566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.613611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:32.613611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:54:32.613611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:54:32.619639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.762475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 761/1498] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:32.766760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.776838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d647998-2589-4796-ab35-c0f3206577fc admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.781414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.782049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.782330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.782603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.783290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.784325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING py.warnings [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:32.784325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: warnings.warn(msg) Aug 01 15:54:32.784325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: Aug 01 15:54:32.785208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.802721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 738/1499] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:32.806284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.816220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb6d2-3ce8-4fde-a546-234179fe46b5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.820796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e3ed2-1243-4dd9-9eed-498dfd48de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.821400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3ed2-1243-4dd9-9eed-498dfd48de22 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.821714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3ed2-1243-4dd9-9eed-498dfd48de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.821993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3ed2-1243-4dd9-9eed-498dfd48de22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.822686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e3ed2-1243-4dd9-9eed-498dfd48de22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.823706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-ba6e3ed2-1243-4dd9-9eed-498dfd48de22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:32.823706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:54:32.823706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:54:32.824591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e3ed2-1243-4dd9-9eed-498dfd48de22 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.837874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 762/1500] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:32.842111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.852509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34b75-9bbb-49b9-8259-ec60e52191ca admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.857001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151add5-6ab8-4a95-8d48-4aeaa35e673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.857755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151add5-6ab8-4a95-8d48-4aeaa35e673f admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.858039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151add5-6ab8-4a95-8d48-4aeaa35e673f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.858335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151add5-6ab8-4a95-8d48-4aeaa35e673f admin admin] PATH_INFO: `/v3/projects/5f89401f0fb34ba28602d0fa7c48b4d0/users/740e851a07c347f48e7dbaa4b40ec3df/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.873791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151add5-6ab8-4a95-8d48-4aeaa35e673f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f89401f0fb34ba28602d0fa7c48b4d0, user_id=740e851a07c347f48e7dbaa4b40ec3df, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.874834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING py.warnings [None req-9151add5-6ab8-4a95-8d48-4aeaa35e673f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:32.874834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: warnings.warn(msg) Aug 01 15:54:32.874834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: Aug 01 15:54:32.876823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151add5-6ab8-4a95-8d48-4aeaa35e673f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.978592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 739/1501] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:54:32 2022] PUT /identity/v3/projects/5f89401f0fb34ba28602d0fa7c48b4d0/users/740e851a07c347f48e7dbaa4b40ec3df/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:32.991507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abd3e-6f64-4f20-b070-b1c5da5af8b2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.991808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abd3e-6f64-4f20-b070-b1c5da5af8b2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.992115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abd3e-6f64-4f20-b070-b1c5da5af8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.019489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5b9abd3e-6f64-4f20-b070-b1c5da5af8b2 None None] MFA Rules not processed for user `740e851a07c347f48e7dbaa4b40ec3df`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:33.020706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5b9abd3e-6f64-4f20-b070-b1c5da5af8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:33.085475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 763/1502] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:33.098704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efff20-19ae-4317-b9ab-bbc1526fd5b2 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.098997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efff20-19ae-4317-b9ab-bbc1526fd5b2 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.099280 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efff20-19ae-4317-b9ab-bbc1526fd5b2 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.101217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 740/1503] 10.222.0.77 () {54 vars in 964 bytes} [Mon Aug 1 15:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:54:33.105964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402855d-0350-4ee4-94ef-a18e933834b5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.106280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402855d-0350-4ee4-94ef-a18e933834b5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.106559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402855d-0350-4ee4-94ef-a18e933834b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.164943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9402855d-0350-4ee4-94ef-a18e933834b5 None None] MFA Rules not processed for user `6bdef4163b5048ed9c9815683a44f019`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:33.166175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9402855d-0350-4ee4-94ef-a18e933834b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:33.241401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 764/1504] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Aug 1 15:54:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:33.249434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efff20-19ae-4317-b9ab-bbc1526fd5b2 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.260977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efff20-19ae-4317-b9ab-bbc1526fd5b2 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.264457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.265062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.265348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.265684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.273944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.275381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.284427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 741/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:54:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:33.331160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b05b6-ba04-4a0d-bf28-a6e962dd3681 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.331447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b05b6-ba04-4a0d-bf28-a6e962dd3681 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.331724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b05b6-ba04-4a0d-bf28-a6e962dd3681 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.333216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 765/1506] 10.222.0.77 () {52 vars in 830 bytes} [Mon Aug 1 15:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:54:33.336819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.397809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10341b03-300b-41c7-b59a-388a7ef674f6 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.402535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.403174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.403459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.403738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] PATH_INFO: `/v3/users/740e851a07c347f48e7dbaa4b40ec3df` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.404904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] RBAC: Authorizing `identity:delete_user(user_id=740e851a07c347f48e7dbaa4b40ec3df)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.405952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING py.warnings [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:33.405952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: warnings.warn(msg) Aug 01 15:54:33.405952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: Aug 01 15:54:33.407157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.824090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740e851a07c347f48e7dbaa4b40ec3df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:33.838213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740e851a07c347f48e7dbaa4b40ec3df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:33.927389 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740e851a07c347f48e7dbaa4b40ec3df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:33.929031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740e851a07c347f48e7dbaa4b40ec3df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:33.952816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:33.955352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740e851a07c347f48e7dbaa4b40ec3df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:33.961491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 742/1507] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:54:33 2022] DELETE /identity/v3/users/740e851a07c347f48e7dbaa4b40ec3df => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:33.966053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.966377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.966688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.985496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:33.986720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:33.996168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:34.044459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 766/1508] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:34.054820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:34.056589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:34.139947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2176eba-9bb7-4d5a-8989-0a002e8b592b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:34.143601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398892b-025b-4d4e-9c87-fb08652f6440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:34.144222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398892b-025b-4d4e-9c87-fb08652f6440 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.144510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398892b-025b-4d4e-9c87-fb08652f6440 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.144793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398892b-025b-4d4e-9c87-fb08652f6440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.154044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398892b-025b-4d4e-9c87-fb08652f6440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:34.155541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398892b-025b-4d4e-9c87-fb08652f6440 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:34.165156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 743/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:34.644247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:34.645847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:34.658620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b79da5-44ac-4c15-a119-2ac48858e0fc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:34.663543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:34.664212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.664499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.664783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] PATH_INFO: `/v3/projects/5f89401f0fb34ba28602d0fa7c48b4d0` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.667321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f89401f0fb34ba28602d0fa7c48b4d0)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:34.667321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:54:34.667321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:54:34.667321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:54:34.668396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:34.779997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f89401f0fb34ba28602d0fa7c48b4d0', 'request_id': 'req-0714f064-fd4a-4317-8752-e189d31c3cab'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.793999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f89401f0fb34ba28602d0fa7c48b4d0', 'request_id': 'req-0714f064-fd4a-4317-8752-e189d31c3cab'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.848108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f89401f0fb34ba28602d0fa7c48b4d0', 'request_id': 'req-0714f064-fd4a-4317-8752-e189d31c3cab'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.860256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] The token cache is being invalidate because project 5f89401f0fb34ba28602d0fa7c48b4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:34.860545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.861173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0714f064-fd4a-4317-8752-e189d31c3cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.862843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 767/1510] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:54:34 2022] DELETE /identity/v3/projects/5f89401f0fb34ba28602d0fa7c48b4d0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:44.160871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:44.856879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:23.960972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f28f30-1f97-4f48-9b12-78c7d564bec1 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:23.961685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f28f30-1f97-4f48-9b12-78c7d564bec1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:23.961685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f28f30-1f97-4f48-9b12-78c7d564bec1 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:23.963103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:23.968246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e629085-c5d2-45ac-a9fb-3a44de69e03d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:23.968705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e629085-c5d2-45ac-a9fb-3a44de69e03d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:23.968820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e629085-c5d2-45ac-a9fb-3a44de69e03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:23.988355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2e629085-c5d2-45ac-a9fb-3a44de69e03d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:23.989585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2e629085-c5d2-45ac-a9fb-3a44de69e03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:24.048609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:24.206481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f28f30-1f97-4f48-9b12-78c7d564bec1 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:24.212372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-80f28f30-1f97-4f48-9b12-78c7d564bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:24.311362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f28f30-1f97-4f48-9b12-78c7d564bec1 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:24.317249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6166ac0-2673-4896-a8e8-ad7a3d802def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:24.317908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6166ac0-2673-4896-a8e8-ad7a3d802def service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:24.318198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6166ac0-2673-4896-a8e8-ad7a3d802def service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:24.318477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6166ac0-2673-4896-a8e8-ad7a3d802def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:24.326766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6166ac0-2673-4896-a8e8-ad7a3d802def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:24.328352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6166ac0-2673-4896-a8e8-ad7a3d802def service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:24.338237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 745/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:25.179971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2dadc-091b-447a-879b-1bc5ad4b4d72 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:25.180512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2dadc-091b-447a-879b-1bc5ad4b4d72 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:25.180512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2dadc-091b-447a-879b-1bc5ad4b4d72 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:25.181865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:25.186892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f4b6-d23f-4e53-a788-dfb868340ff1 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:25.187310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f4b6-d23f-4e53-a788-dfb868340ff1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:25.192860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f4b6-d23f-4e53-a788-dfb868340ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:25.208687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7eb3f4b6-d23f-4e53-a788-dfb868340ff1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:25.210000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7eb3f4b6-d23f-4e53-a788-dfb868340ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:25.218187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:25.376686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2dadc-091b-447a-879b-1bc5ad4b4d72 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:25.391098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2dadc-091b-447a-879b-1bc5ad4b4d72 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:25.396522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa678961-f6dd-435f-8a32-44e957eaebc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:25.397280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa678961-f6dd-435f-8a32-44e957eaebc5 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:25.397604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa678961-f6dd-435f-8a32-44e957eaebc5 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:25.397889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa678961-f6dd-435f-8a32-44e957eaebc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:25.406184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa678961-f6dd-435f-8a32-44e957eaebc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:25.408304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa678961-f6dd-435f-8a32-44e957eaebc5 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:25.417691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 770/1516] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:25.754415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5569e-b4a0-404c-a1ec-20966a13ad92 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:25.754735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5569e-b4a0-404c-a1ec-20966a13ad92 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:25.754994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5569e-b4a0-404c-a1ec-20966a13ad92 None None] PATH_INFO: `/v3` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:25.756324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 747/1517] 10.222.0.57 () {54 vars in 925 bytes} [Mon Aug 1 15:56:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:56:25.762468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bb6ae-6e20-4237-84ee-392b2932af63 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:25.762757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bb6ae-6e20-4237-84ee-392b2932af63 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:25.763041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bb6ae-6e20-4237-84ee-392b2932af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:25.814369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ca1bb6ae-6e20-4237-84ee-392b2932af63 None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:25.815592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ca1bb6ae-6e20-4237-84ee-392b2932af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:25.886325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 771/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Aug 1 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:29.908557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc74e-6878-44a7-8d36-c63b348e608e None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:29.909198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc74e-6878-44a7-8d36-c63b348e608e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:29.909198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc74e-6878-44a7-8d36-c63b348e608e None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:29.910519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 748/1519] 10.222.0.77 () {54 vars in 961 bytes} [Mon Aug 1 15:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:29.915606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8eaa-3b26-4806-9db1-d86e8f14cdfa None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:29.916020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8eaa-3b26-4806-9db1-d86e8f14cdfa None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:29.916170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8eaa-3b26-4806-9db1-d86e8f14cdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:29.936303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-804c8eaa-3b26-4806-9db1-d86e8f14cdfa None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:29.937509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-804c8eaa-3b26-4806-9db1-d86e8f14cdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:29.946394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 772/1520] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Aug 1 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:29.956256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc74e-6878-44a7-8d36-c63b348e608e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:29.978739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc74e-6878-44a7-8d36-c63b348e608e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:29.984341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5bdd9-04b1-4376-97d7-d5f97c3a339e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:29.985574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5bdd9-04b1-4376-97d7-d5f97c3a339e service placement] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:29.992023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5bdd9-04b1-4376-97d7-d5f97c3a339e service placement] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:29.992023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5bdd9-04b1-4376-97d7-d5f97c3a339e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:29.995956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5bdd9-04b1-4376-97d7-d5f97c3a339e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:29.997571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5bdd9-04b1-4376-97d7-d5f97c3a339e service placement] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:30.007607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 749/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:56:36.654569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2a024-7f1d-4611-91dc-96b60e28c138 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.655188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2a024-7f1d-4611-91dc-96b60e28c138 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.655188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2a024-7f1d-4611-91dc-96b60e28c138 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.656940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 773/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:36.662114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc50af9-bfbf-4560-9fd3-1352ab2c5050 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.662592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc50af9-bfbf-4560-9fd3-1352ab2c5050 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.662700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc50af9-bfbf-4560-9fd3-1352ab2c5050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.682979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4cc50af9-bfbf-4560-9fd3-1352ab2c5050 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:36.684196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4cc50af9-bfbf-4560-9fd3-1352ab2c5050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:36.692267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 750/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:36.844590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2a024-7f1d-4611-91dc-96b60e28c138 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:36.858716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2a024-7f1d-4611-91dc-96b60e28c138 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:36.865194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65d57d-d502-4af6-a980-830233f9c745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:36.865830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d57d-d502-4af6-a980-830233f9c745 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.866115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d57d-d502-4af6-a980-830233f9c745 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.866394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d57d-d502-4af6-a980-830233f9c745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.874550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65d57d-d502-4af6-a980-830233f9c745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:36.876180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65d57d-d502-4af6-a980-830233f9c745 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:36.885849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 774/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:37.714797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0c6d-426b-4fc0-9fe8-21378cb15e83 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:37.715341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0c6d-426b-4fc0-9fe8-21378cb15e83 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:37.715341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0c6d-426b-4fc0-9fe8-21378cb15e83 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:37.716624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:37.721569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f1bf-3edd-4124-8bb3-b7b23be8226b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:37.722272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f1bf-3edd-4124-8bb3-b7b23be8226b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:37.722272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f1bf-3edd-4124-8bb3-b7b23be8226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:37.742074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6049f1bf-3edd-4124-8bb3-b7b23be8226b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:37.743585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6049f1bf-3edd-4124-8bb3-b7b23be8226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:37.751993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:37.903866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0c6d-426b-4fc0-9fe8-21378cb15e83 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:37.918636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0c6d-426b-4fc0-9fe8-21378cb15e83 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:37.924808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333104d-3c6a-4f60-b221-c1c20b060c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:37.925430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333104d-3c6a-4f60-b221-c1c20b060c6a service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:37.925748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333104d-3c6a-4f60-b221-c1c20b060c6a service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:37.926029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333104d-3c6a-4f60-b221-c1c20b060c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:37.935012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333104d-3c6a-4f60-b221-c1c20b060c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:37.936617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333104d-3c6a-4f60-b221-c1c20b060c6a service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:37.947171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 752/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:41.888051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74a76-4f63-4956-a340-4b7a2d464912 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:41.888595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74a76-4f63-4956-a340-4b7a2d464912 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:41.888595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74a76-4f63-4956-a340-4b7a2d464912 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:41.890017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:41.895149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1647f8-dfa6-4cda-9842-2c064558a858 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:41.895558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1647f8-dfa6-4cda-9842-2c064558a858 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:41.895705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1647f8-dfa6-4cda-9842-2c064558a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:41.915643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-bb1647f8-dfa6-4cda-9842-2c064558a858 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:41.916852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bb1647f8-dfa6-4cda-9842-2c064558a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:41.925211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:41.998111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74a76-4f63-4956-a340-4b7a2d464912 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:41.999846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e0b74a76-4f63-4956-a340-4b7a2d464912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:42.027115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:42.057116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74a76-4f63-4956-a340-4b7a2d464912 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:42.060923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeda43-a29e-4871-bd24-6c0d52385a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:42.062415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeda43-a29e-4871-bd24-6c0d52385a53 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:42.062415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeda43-a29e-4871-bd24-6c0d52385a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:42.062641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeda43-a29e-4871-bd24-6c0d52385a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:42.071765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeda43-a29e-4871-bd24-6c0d52385a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:42.073253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeda43-a29e-4871-bd24-6c0d52385a53 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:42.083016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 777/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:44.075287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3085-64bd-4f52-9794-54077fdefbb8 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:44.075881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3085-64bd-4f52-9794-54077fdefbb8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:44.075881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3085-64bd-4f52-9794-54077fdefbb8 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:44.077219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:44.082986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9feddc-e4a9-427c-9279-11e51c20c11d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:44.083453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9feddc-e4a9-427c-9279-11e51c20c11d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:44.083563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9feddc-e4a9-427c-9279-11e51c20c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:44.104784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4f9feddc-e4a9-427c-9279-11e51c20c11d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:44.105665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4f9feddc-e4a9-427c-9279-11e51c20c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:44.114285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:44.153407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d3085-64bd-4f52-9794-54077fdefbb8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:44.155206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f50d3085-64bd-4f52-9794-54077fdefbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:44.168133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d3085-64bd-4f52-9794-54077fdefbb8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:44.171737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede91468-f14f-4855-84c7-b116edd89614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:44.174059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91468-f14f-4855-84c7-b116edd89614 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:44.174587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91468-f14f-4855-84c7-b116edd89614 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:44.174914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91468-f14f-4855-84c7-b116edd89614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:44.185607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede91468-f14f-4855-84c7-b116edd89614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:44.189971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede91468-f14f-4855-84c7-b116edd89614 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:44.197725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 755/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:47.850661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08255b-be52-46ba-8cea-ba2bfe2f5af3 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:47.851239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08255b-be52-46ba-8cea-ba2bfe2f5af3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:47.851239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08255b-be52-46ba-8cea-ba2bfe2f5af3 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:47.852590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:47.857881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1571-46c1-466b-bb26-5667abaf1a31 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:47.858466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1571-46c1-466b-bb26-5667abaf1a31 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:47.858466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1571-46c1-466b-bb26-5667abaf1a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:47.866714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=74 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:47.878785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8b5d1571-46c1-466b-bb26-5667abaf1a31 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:47.887871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8b5d1571-46c1-466b-bb26-5667abaf1a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:47.888050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:48.204067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08255b-be52-46ba-8cea-ba2bfe2f5af3 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:48.206106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9b08255b-be52-46ba-8cea-ba2bfe2f5af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:48.265230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08255b-be52-46ba-8cea-ba2bfe2f5af3 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:48.269017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ae2b8-6de5-4044-9b43-32f7d0f6cc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:48.269652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae2b8-6de5-4044-9b43-32f7d0f6cc47 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:48.269939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae2b8-6de5-4044-9b43-32f7d0f6cc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:48.270216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae2b8-6de5-4044-9b43-32f7d0f6cc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:48.279888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ae2b8-6de5-4044-9b43-32f7d0f6cc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:48.281349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ae2b8-6de5-4044-9b43-32f7d0f6cc47 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:48.292148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 780/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:50.359292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22fea-cb7c-4b2d-96fa-68032100b365 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:50.360634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22fea-cb7c-4b2d-96fa-68032100b365 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:50.360634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22fea-cb7c-4b2d-96fa-68032100b365 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:50.361910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:56:50.367976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e525-5627-484c-a042-ae30799c44f4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:50.368465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e525-5627-484c-a042-ae30799c44f4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:50.368575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e525-5627-484c-a042-ae30799c44f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:50.387814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1312e525-5627-484c-a042-ae30799c44f4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:50.389029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1312e525-5627-484c-a042-ae30799c44f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:50.397615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:50.702500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a22fea-cb7c-4b2d-96fa-68032100b365 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:50.704219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-83a22fea-cb7c-4b2d-96fa-68032100b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:50.716955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a22fea-cb7c-4b2d-96fa-68032100b365 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:50.721011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5272f45-6fff-43ff-9482-701c09cf8920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:50.721663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5272f45-6fff-43ff-9482-701c09cf8920 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:50.721951 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5272f45-6fff-43ff-9482-701c09cf8920 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:50.722228 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5272f45-6fff-43ff-9482-701c09cf8920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:50.731274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5272f45-6fff-43ff-9482-701c09cf8920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:50.732702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5272f45-6fff-43ff-9482-701c09cf8920 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:50.742830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 758/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:57:00.382459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=47 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:00.738757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=8 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:25.359626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b3e6-b4d9-4c40-92fc-3c6d41fce394 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.379832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b3e6-b4d9-4c40-92fc-3c6d41fce394 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.379832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b3e6-b4d9-4c40-92fc-3c6d41fce394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.389770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2308b3e6-b4d9-4c40-92fc-3c6d41fce394 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.391015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2308b3e6-b4d9-4c40-92fc-3c6d41fce394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.400402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 782/1540] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.409343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7192d-e1ee-4b7e-a97b-4f40437b8467 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.410044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7192d-e1ee-4b7e-a97b-4f40437b8467 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.410044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7192d-e1ee-4b7e-a97b-4f40437b8467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.438885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-12e7192d-e1ee-4b7e-a97b-4f40437b8467 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.440103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-12e7192d-e1ee-4b7e-a97b-4f40437b8467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.455533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 759/1541] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.460710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308b3e6-b4d9-4c40-92fc-3c6d41fce394 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:25.475118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308b3e6-b4d9-4c40-92fc-3c6d41fce394 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:25.484601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37ba41-f782-4274-9755-8f87c4c2bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:25.485239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37ba41-f782-4274-9755-8f87c4c2bdfc admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.485546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37ba41-f782-4274-9755-8f87c4c2bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.485923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37ba41-f782-4274-9755-8f87c4c2bdfc admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.486528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37ba41-f782-4274-9755-8f87c4c2bdfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:25.486838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37ba41-f782-4274-9755-8f87c4c2bdfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:25.488513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37ba41-f782-4274-9755-8f87c4c2bdfc admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:25.506156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 783/1542] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:25.515695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7192d-e1ee-4b7e-a97b-4f40437b8467 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:25.531292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7192d-e1ee-4b7e-a97b-4f40437b8467 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:25.538712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311d19f-ba57-4b9b-a036-2fc7d8091836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:25.539366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311d19f-ba57-4b9b-a036-2fc7d8091836 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.539650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311d19f-ba57-4b9b-a036-2fc7d8091836 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.539928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311d19f-ba57-4b9b-a036-2fc7d8091836 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.540638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311d19f-ba57-4b9b-a036-2fc7d8091836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:25.542689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311d19f-ba57-4b9b-a036-2fc7d8091836 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:25.564534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0b4b-0e7b-4072-a4a2-dd07928b13cf None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.564534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0b4b-0e7b-4072-a4a2-dd07928b13cf None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.564534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0b4b-0e7b-4072-a4a2-dd07928b13cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.594896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-cb9d0b4b-0e7b-4072-a4a2-dd07928b13cf None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.596429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cb9d0b4b-0e7b-4072-a4a2-dd07928b13cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.608924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 784/1543] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.610220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a74c9e-eee4-4b7b-84c4-671642d9a9bf None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.610509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a74c9e-eee4-4b7b-84c4-671642d9a9bf None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.610787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a74c9e-eee4-4b7b-84c4-671642d9a9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.637802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-21a74c9e-eee4-4b7b-84c4-671642d9a9bf None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.639009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-21a74c9e-eee4-4b7b-84c4-671642d9a9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.651826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 785/1544] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.653178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ed67-1bef-4da2-ab66-4720140f02c9 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.653464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ed67-1bef-4da2-ab66-4720140f02c9 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.653770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ed67-1bef-4da2-ab66-4720140f02c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.667034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 760/1545] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:25.668502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22868-51fd-45fb-91f2-1728a1550752 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.668698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22868-51fd-45fb-91f2-1728a1550752 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.669231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22868-51fd-45fb-91f2-1728a1550752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.683138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0753ed67-1bef-4da2-ab66-4720140f02c9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.684397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0753ed67-1bef-4da2-ab66-4720140f02c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.718385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-50a22868-51fd-45fb-91f2-1728a1550752 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.719462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-50a22868-51fd-45fb-91f2-1728a1550752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.807090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 786/1546] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.810083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce9cc-b1ac-488e-aafe-3992aa9bfed4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.810083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce9cc-b1ac-488e-aafe-3992aa9bfed4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.810083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce9cc-b1ac-488e-aafe-3992aa9bfed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.829064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 761/1547] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.829648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a22868-51fd-45fb-91f2-1728a1550752 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:25.832319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-506ce9cc-b1ac-488e-aafe-3992aa9bfed4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.833536 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-506ce9cc-b1ac-488e-aafe-3992aa9bfed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.840223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a22868-51fd-45fb-91f2-1728a1550752 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:25.842751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 787/1548] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.845401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:25.846211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.846499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.846800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.847549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:25.847677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee040-9ecf-467c-bf7e-a555ae1242a2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.847990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee040-9ecf-467c-bf7e-a555ae1242a2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.848283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee040-9ecf-467c-bf7e-a555ae1242a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.848636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING py.warnings [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:58:25.848636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: warnings.warn(msg) Aug 01 15:58:25.848636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: Aug 01 15:58:25.849878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:25.870086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3c0ee040-9ecf-467c-bf7e-a555ae1242a2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.871684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3c0ee040-9ecf-467c-bf7e-a555ae1242a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.882401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 788/1549] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.884407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9531-2a2b-4ecd-b61a-7e672a553246 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.884693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9531-2a2b-4ecd-b61a-7e672a553246 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.884973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9531-2a2b-4ecd-b61a-7e672a553246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.907610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5a6e9531-2a2b-4ecd-b61a-7e672a553246 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.908998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5a6e9531-2a2b-4ecd-b61a-7e672a553246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.917545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 789/1550] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.918325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9531-2a2b-4ecd-b61a-7e672a553246 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:25.928530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9531-2a2b-4ecd-b61a-7e672a553246 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:25.933305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68a07-61c7-43dc-b59e-57ea37da2073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:25.939124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68a07-61c7-43dc-b59e-57ea37da2073 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.939124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68a07-61c7-43dc-b59e-57ea37da2073 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.939124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68a07-61c7-43dc-b59e-57ea37da2073 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.939124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68a07-61c7-43dc-b59e-57ea37da2073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:25.939124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68a07-61c7-43dc-b59e-57ea37da2073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:25.939124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68a07-61c7-43dc-b59e-57ea37da2073 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:25.948530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 790/1551] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:25.949737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878289b-9ccc-4ee4-9a87-e7bb7b069a0e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.950031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878289b-9ccc-4ee4-9a87-e7bb7b069a0e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.950389 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878289b-9ccc-4ee4-9a87-e7bb7b069a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.966563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 762/1552] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:25.967523 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:25.968835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3878289b-9ccc-4ee4-9a87-e7bb7b069a0e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:25.970063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3878289b-9ccc-4ee4-9a87-e7bb7b069a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:25.978078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb8516-40af-48dc-9688-c7ddfdebbe41 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:25.979579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 791/1553] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:25.980279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820b95-6dff-49aa-9ed6-27abdf8e71c0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.980575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820b95-6dff-49aa-9ed6-27abdf8e71c0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.980856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9820b95-6dff-49aa-9ed6-27abdf8e71c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.986129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:25.986937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:25.987256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:25.987626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:25.988982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:25.989292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:25.990461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING py.warnings [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:58:25.990461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: warnings.warn(msg) Aug 01 15:58:25.990461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: Aug 01 15:58:25.991676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247588d-0d04-439e-8268-3227cd7cf3dc admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.001994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b9820b95-6dff-49aa-9ed6-27abdf8e71c0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:26.003195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b9820b95-6dff-49aa-9ed6-27abdf8e71c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:26.004497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 763/1554] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:26.005754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697ac8-c8b9-4969-b396-651754a0671e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.006052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697ac8-c8b9-4969-b396-651754a0671e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.006334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697ac8-c8b9-4969-b396-651754a0671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.019058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 792/1555] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:26.020308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcc4e-273f-4929-97a6-a17c003480ea None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.020599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcc4e-273f-4929-97a6-a17c003480ea None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.020881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcc4e-273f-4929-97a6-a17c003480ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.025837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b1697ac8-c8b9-4969-b396-651754a0671e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:26.027042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b1697ac8-c8b9-4969-b396-651754a0671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:26.035396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 764/1556] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:26.036610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a954cae-1f13-4e0e-bbe7-bb20443b6f76 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.036903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a954cae-1f13-4e0e-bbe7-bb20443b6f76 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.037181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a954cae-1f13-4e0e-bbe7-bb20443b6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.040520 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3f5bcc4e-273f-4929-97a6-a17c003480ea None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:26.041740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3f5bcc4e-273f-4929-97a6-a17c003480ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:26.049585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 793/1557] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:26.050922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcc4e-273f-4929-97a6-a17c003480ea None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.059976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-5a954cae-1f13-4e0e-bbe7-bb20443b6f76 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:26.060287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcc4e-273f-4929-97a6-a17c003480ea None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.061171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5a954cae-1f13-4e0e-bbe7-bb20443b6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:26.064901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a3b86-95e1-4e5c-ac7f-879acbdf0290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.065508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3b86-95e1-4e5c-ac7f-879acbdf0290 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.065841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3b86-95e1-4e5c-ac7f-879acbdf0290 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.066123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3b86-95e1-4e5c-ac7f-879acbdf0290 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.066785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a3b86-95e1-4e5c-ac7f-879acbdf0290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.067809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-869a3b86-95e1-4e5c-ac7f-879acbdf0290 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:58:26.067809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:58:26.067809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:58:26.069004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a3b86-95e1-4e5c-ac7f-879acbdf0290 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.069440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 765/1558] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:26.070249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a954cae-1f13-4e0e-bbe7-bb20443b6f76 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.082575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a954cae-1f13-4e0e-bbe7-bb20443b6f76 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.087268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.087882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.088167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.088443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.089217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.090866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.101571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 766/1559] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:26.102380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.111956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b0d6b-ae9d-49a5-a7d0-36a905ff642c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.117194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.117816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.118142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.118416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.119224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:26.119532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.121692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.137535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 767/1560] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:26.139664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.148069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412fab-f7fa-4ce4-9347-1e3ae1d9ac33 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.152617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.153210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.153503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.153808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.154457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.156471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.195222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 794/1561] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:26.196717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d0a2-0a2e-4a4d-ae5a-abb6997e37fb None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.197025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d0a2-0a2e-4a4d-ae5a-abb6997e37fb None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.197313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d0a2-0a2e-4a4d-ae5a-abb6997e37fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.216061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6ef0d0a2-0a2e-4a4d-ae5a-abb6997e37fb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:26.217257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6ef0d0a2-0a2e-4a4d-ae5a-abb6997e37fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:26.260107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 768/1562] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:26.263661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.266887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:26.283361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 795/1563] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:26.286434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0d0a2-0a2e-4a4d-ae5a-abb6997e37fb None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.296934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0d0a2-0a2e-4a4d-ae5a-abb6997e37fb None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.309829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:26.328513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bd954-fdcc-4c56-bf0e-49f5e44f3d56 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.333875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c4944-8475-4c02-9cff-d810e663a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.334433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4944-8475-4c02-9cff-d810e663a0aa admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.334728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4944-8475-4c02-9cff-d810e663a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.335012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4944-8475-4c02-9cff-d810e663a0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.335712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c4944-8475-4c02-9cff-d810e663a0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:26.336022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c4944-8475-4c02-9cff-d810e663a0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.337682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c4944-8475-4c02-9cff-d810e663a0aa admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.351582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 769/1564] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:26.355962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83f8a-96a9-493b-888c-af334522c0ff None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.355962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83f8a-96a9-493b-888c-af334522c0ff None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.355962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83f8a-96a9-493b-888c-af334522c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.356259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.356259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.356259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.356259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.356792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:26.356792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.358141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.370804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 796/1565] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:26.371578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.373829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c7f83f8a-96a9-493b-888c-af334522c0ff None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:26.375099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c7f83f8a-96a9-493b-888c-af334522c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:26.382484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03a813-c95f-4dc0-900d-9df7f1926605 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.384355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 770/1566] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:26.384355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83f8a-96a9-493b-888c-af334522c0ff None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.390052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.391025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.391320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.391600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.392297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.393702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83f8a-96a9-493b-888c-af334522c0ff None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.394526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.399691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.400780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.401060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.401331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.402049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.404073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.405241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 797/1567] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:26.406193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.418223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724705-3948-4698-9f06-1b7f5bf20aba admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.423172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.423786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.424076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.424354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.425008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.426995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.526085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 771/1568] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:26.526904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.555738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 798/1569] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:26.555738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.564629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc92c40-478a-47c6-9515-a84547bc7a5f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.593712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2543a-195d-44ba-bdc9-3a766a5e2793 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.598997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.601997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.601997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.601997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.601997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.602991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.620553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.621229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.621509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.621816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.622519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:26.622818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.624411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.636422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 799/1570] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:26.637123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.647192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031212c7-067c-4782-9a4f-77e20bdee993 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.652131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.652748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.653909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.659020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.659020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.659020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.687606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 772/1571] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:26.687606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.695533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f3407-8800-4ce0-a726-d06d70cfc34b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.700177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.700792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.701079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.701476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.702085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.704019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.761634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 800/1572] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:26.762668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.787263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 773/1573] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:26.787263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.797140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:26.828628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba591-25e8-44cf-aec9-644c91cd1d3e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.851395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6d5ad-47f3-4198-89c6-97030c91a064 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.856214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.857042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.857653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.857653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] PATH_INFO: `/v3/projects/4c2147ae553446c982f2368f1bb1a6e0/users/df9d84db168a4612be9e98681d12bcd7/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.872199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2147ae553446c982f2368f1bb1a6e0, user_id=df9d84db168a4612be9e98681d12bcd7, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.875342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.887400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.888081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.888365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.888641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.889373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:26.889717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.894725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.903490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 801/1574] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:26.904258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:26.913499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a67d-166f-4461-babc-d723460e7d0c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:26.918019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:26.918581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:26.918866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:26.919205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:26.919916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:26.921867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:26.937393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:26.943425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 774/1575] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:26 2022] PUT /identity/v3/projects/4c2147ae553446c982f2368f1bb1a6e0/users/df9d84db168a4612be9e98681d12bcd7/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:26.944212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.006900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db5bf3-92d6-444a-9e38-847ca7a2ff8c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.011443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.012116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.012955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.012955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.013392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.015014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.026352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 775/1576] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.027171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.032476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 802/1577] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:26 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:27.036324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.037910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d747cc9-50d2-4dd1-a504-109d9a857207 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.042982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.043231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353774d-7eaf-4e21-b727-62f227f95a62 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.043911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.044309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.045137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.046375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.050937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.051303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.051905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.052356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.052809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.054012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.056887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.070216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 803/1578] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.071072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.080711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2966-2b75-4bae-8aa1-38803b501d8c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.085640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.086226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.086509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.086781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.087429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.089541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.127243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 776/1579] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:27.128061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.165675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 804/1580] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:27.166637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.177681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c92d8f-b043-4309-80f9-4b552eff94b3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.196952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2b351-a5e2-4390-8489-cb35412981c5 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.201979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1fb62-c412-46da-8c95-a273a97736df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.202610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1fb62-c412-46da-8c95-a273a97736df admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.202896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1fb62-c412-46da-8c95-a273a97736df admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.203177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1fb62-c412-46da-8c95-a273a97736df admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.203840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1fb62-c412-46da-8c95-a273a97736df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.205838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1fb62-c412-46da-8c95-a273a97736df admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.236206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.236832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.237152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.237458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.238659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.240588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.301793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 777/1581] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/users => generated 279 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:27.303185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655403c5-d5cd-43bb-bbba-199a94596c3b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.303488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655403c5-d5cd-43bb-bbba-199a94596c3b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.303979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655403c5-d5cd-43bb-bbba-199a94596c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.326150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-655403c5-d5cd-43bb-bbba-199a94596c3b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:27.328686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-655403c5-d5cd-43bb-bbba-199a94596c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:27.328813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 805/1582] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:27.329460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.341106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:27.386760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 778/1583] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:27.387511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655403c5-d5cd-43bb-bbba-199a94596c3b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.391933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:27.397931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655403c5-d5cd-43bb-bbba-199a94596c3b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.398115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837938-b5b8-4c0f-a1b0-6d468d8f9a7d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.403267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.403611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.403903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.404442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.404587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.404706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.404803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.404803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.405150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.405567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.411286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.411425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.418176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 779/1584] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.420972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.421144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 806/1585] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.421144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.430963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d573d-1920-42e9-a90f-5f1337d74f71 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.434309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f4c05-c616-40ea-a758-e4e8683d1025 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.436048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.436664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.436797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.437178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.437295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.437465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.437616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.437878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.438312 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.438560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.440138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.440299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.453688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 780/1586] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.454683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.464184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0320a-f0dd-4f70-b8a1-88bff8127590 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.469619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.472748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.472748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.472748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.472748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.473671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.483375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 781/1587] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.484128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.493918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13bb2-65d9-4b84-bd3d-3d86cfe2742f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.498403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.498973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.499260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.499566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.500229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.501789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.511609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 782/1588] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.512463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.522535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5e486-c016-44bb-9ab1-e42d16d7a119 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.526509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.529554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.529554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.529554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.529554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.530308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.560110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 807/1589] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:27.560938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.616087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef2272-1dbc-4a5d-8436-19fd40e41aef admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.619723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.621444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.621444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.621444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.629826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.631270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.640835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 808/1590] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:27.641557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.645866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 783/1591] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:27.646852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.654521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65500e5-84d6-49dc-b37b-6575e1bc9ca4 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.657062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d950e-6888-4c08-a7be-c2699b488672 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.660074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.660761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.661017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.661301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.662225 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.662748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.663516 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.663800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.663979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.664099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] PATH_INFO: `/v3/projects/ad8343ba84724cf1a53b40d346623657/users/2c1113cbce924ad9b68690db65c58232/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.678402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 809/1592] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.678402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.680134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8343ba84724cf1a53b40d346623657, user_id=2c1113cbce924ad9b68690db65c58232, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.683164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.688679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762df8-a56c-4d7b-ba04-006db3cb639d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.693578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.694237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.694632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.694872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] PATH_INFO: `/v3/projects/608811334b384e299084e12b27b50f04/users/1f30bfa8b6e2449493810c05754bf8c1/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.710243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] RBAC: Authorizing `identity:create_grant(project_id=608811334b384e299084e12b27b50f04, user_id=1f30bfa8b6e2449493810c05754bf8c1, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.711325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:58:27.711325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:58:27.711325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:58:27.713306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.730934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 784/1593] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:27 2022] PUT /identity/v3/projects/ad8343ba84724cf1a53b40d346623657/users/2c1113cbce924ad9b68690db65c58232/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:27.735615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.775414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 810/1594] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:27 2022] PUT /identity/v3/projects/608811334b384e299084e12b27b50f04/users/1f30bfa8b6e2449493810c05754bf8c1/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:27.775414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.810810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd43c-09c2-412e-9c75-6d400106cf66 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.838867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:27.841716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96990323-a2c0-4c95-9ab8-3d2ff081664c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.847754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.848515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.849910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.849910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.850501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.852143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.863711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 811/1595] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.864601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.874879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.875352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.875705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.875990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.876691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.877081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d4451-45c1-48a5-bab5-1f7cd57cc912 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.878454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.883148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.883985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.884639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.885048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.885983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.888123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.889387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 785/1596] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.892264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.901802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 812/1597] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.902675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:27.903354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea540a1-aebb-483f-a378-7b748d9df5c4 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.909482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7b6b8-9f19-4d27-be00-249609b5a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.911208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7b6b8-9f19-4d27-be00-249609b5a626 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.911498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7b6b8-9f19-4d27-be00-249609b5a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.911863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7b6b8-9f19-4d27-be00-249609b5a626 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.912608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7b6b8-9f19-4d27-be00-249609b5a626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.919206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044c81-3435-4550-8803-ecca3c6b25e5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:27.919366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7b6b8-9f19-4d27-be00-249609b5a626 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.933006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 786/1598] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:27.934516 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c617158-d36f-414a-b3bd-b45ea032bce5 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.934810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c617158-d36f-414a-b3bd-b45ea032bce5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.935091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c617158-d36f-414a-b3bd-b45ea032bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.938407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:27.939763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.940493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.941613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] PATH_INFO: `/v3/projects/644fb4a0de044796858aabf5cdb2d886/users/4de02bad21e240ae97f0092e39f782dd/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.958544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-3c617158-d36f-414a-b3bd-b45ea032bce5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:27.959776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3c617158-d36f-414a-b3bd-b45ea032bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:27.960144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644fb4a0de044796858aabf5cdb2d886, user_id=4de02bad21e240ae97f0092e39f782dd, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:27.963591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:27.969839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 787/1599] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:27.974900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727afc2b-25d5-44be-8ece-96ad2be7773a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:27.975254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727afc2b-25d5-44be-8ece-96ad2be7773a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:27.975614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727afc2b-25d5-44be-8ece-96ad2be7773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:27.983024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:27.996444 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-727afc2b-25d5-44be-8ece-96ad2be7773a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:27.997696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-727afc2b-25d5-44be-8ece-96ad2be7773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:28.006926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 788/1600] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:28.009670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727afc2b-25d5-44be-8ece-96ad2be7773a None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.017624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727afc2b-25d5-44be-8ece-96ad2be7773a None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.022751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.023410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.023695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.023968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] PATH_INFO: `/v3/projects/ee3d3e0532c841cba91360873f962381/users/2973e7aee68e4f378590175d021450d7/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.038606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3d3e0532c841cba91360873f962381, user_id=2973e7aee68e4f378590175d021450d7, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.041274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.061386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 813/1601] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:27 2022] PUT /identity/v3/projects/644fb4a0de044796858aabf5cdb2d886/users/4de02bad21e240ae97f0092e39f782dd/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:28.065676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.127311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294f3e-3444-4c2c-9179-34c4aa8bcde2 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.132658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.133476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.133714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.134099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] PATH_INFO: `/v3/projects/64a75a8e4ea541fcb5e618f65495dc7f/users/debe5286d7c344de97c61686195507ee/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.141454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 789/1602] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:28 2022] PUT /identity/v3/projects/ee3d3e0532c841cba91360873f962381/users/2973e7aee68e4f378590175d021450d7/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:28.151876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a75a8e4ea541fcb5e618f65495dc7f, user_id=debe5286d7c344de97c61686195507ee, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.155140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.159349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.228689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903ef64-fe33-4d3e-80f7-12f269c42df0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.233565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.236307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.236307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.236307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.236307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.237436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.248652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 790/1603] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:28.249545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.260989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ffdb-abf1-4a9d-9676-de47e66d2f40 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.266917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.270701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.270701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.270701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.270701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.271592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.273418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 814/1604] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:28 2022] PUT /identity/v3/projects/64a75a8e4ea541fcb5e618f65495dc7f/users/debe5286d7c344de97c61686195507ee/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:28.275273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.285076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 791/1605] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:28.286432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.364396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280454b-3c3a-4ed7-9aac-faa8c087628a admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.365125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd44f-063f-42f5-853d-64aa25ae7f21 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.369152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670d47c-196d-4984-bf80-a668a9477eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.369345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba106ccf-5333-4c17-a948-7de50c212220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.369913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670d47c-196d-4984-bf80-a668a9477eab service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.370048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba106ccf-5333-4c17-a948-7de50c212220 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.370197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670d47c-196d-4984-bf80-a668a9477eab service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.370325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba106ccf-5333-4c17-a948-7de50c212220 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.370474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670d47c-196d-4984-bf80-a668a9477eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.370607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba106ccf-5333-4c17-a948-7de50c212220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.438243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:28.441045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba106ccf-5333-4c17-a948-7de50c212220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.442853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba106ccf-5333-4c17-a948-7de50c212220 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.448959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670d47c-196d-4984-bf80-a668a9477eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.450557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670d47c-196d-4984-bf80-a668a9477eab service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.454320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 792/1606] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:28.455817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448910c-0f0a-448e-a4dd-d420ec150c40 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.460090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448910c-0f0a-448e-a4dd-d420ec150c40 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.460090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448910c-0f0a-448e-a4dd-d420ec150c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.466930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 815/1607] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:28.468329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380151-a004-4a52-9acc-af4c9496e968 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.468690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380151-a004-4a52-9acc-af4c9496e968 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.469040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380151-a004-4a52-9acc-af4c9496e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.470655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:28.490261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0448910c-0f0a-448e-a4dd-d420ec150c40 None None] MFA Rules not processed for user `4de02bad21e240ae97f0092e39f782dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:28.491556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0448910c-0f0a-448e-a4dd-d420ec150c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:28.505297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2e380151-a004-4a52-9acc-af4c9496e968 None None] MFA Rules not processed for user `2973e7aee68e4f378590175d021450d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:28.506895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2e380151-a004-4a52-9acc-af4c9496e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:28.567125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 793/1608] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:28.571181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448910c-0f0a-448e-a4dd-d420ec150c40 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.577923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 816/1609] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:28.587810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763462-0398-4d4f-ba03-24a9aa3b7628 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.587810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763462-0398-4d4f-ba03-24a9aa3b7628 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.587810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763462-0398-4d4f-ba03-24a9aa3b7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.588232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448910c-0f0a-448e-a4dd-d420ec150c40 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.591021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.591713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.591998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.592329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] PATH_INFO: `/v3/projects/35956ef27743401c87e0b7332dee6880/users/a789579f4c364938bfc445030aad9c78/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.602105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-af763462-0398-4d4f-ba03-24a9aa3b7628 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:28.603388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-af763462-0398-4d4f-ba03-24a9aa3b7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:28.610640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35956ef27743401c87e0b7332dee6880, user_id=a789579f4c364938bfc445030aad9c78, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.616498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 817/1610] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:28.616770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.616903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763462-0398-4d4f-ba03-24a9aa3b7628 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.627375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763462-0398-4d4f-ba03-24a9aa3b7628 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.633581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.634693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.634984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.635268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] PATH_INFO: `/v3/projects/490886e1790b47cabee664f39fa2215a/users/aca0168b829f466c8fdfe10a7be46066/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.652452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=490886e1790b47cabee664f39fa2215a, user_id=aca0168b829f466c8fdfe10a7be46066, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.655223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.714904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 794/1611] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:28 2022] PUT /identity/v3/projects/35956ef27743401c87e0b7332dee6880/users/a789579f4c364938bfc445030aad9c78/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:28.717359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.732764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 818/1612] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:28 2022] PUT /identity/v3/projects/490886e1790b47cabee664f39fa2215a/users/aca0168b829f466c8fdfe10a7be46066/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:28.733623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.812006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072687c-0109-40dd-a764-200c122881f3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.817958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aa60-8518-4a3f-9ea5-d56a00eb416e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:28.818228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.819075 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.819372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.819652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.820469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.822499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.823455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1082a-b7a2-47f7-983f-f96501366185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:28.824145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1082a-b7a2-47f7-983f-f96501366185 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.824537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1082a-b7a2-47f7-983f-f96501366185 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.824783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1082a-b7a2-47f7-983f-f96501366185 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:28.826464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1082a-b7a2-47f7-983f-f96501366185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:28.831982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1082a-b7a2-47f7-983f-f96501366185 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:28.947148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 819/1613] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:28 2022] POST /identity/v3/projects => generated 357 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:28.948099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:28.981332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 795/1614] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:28 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:28.981332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f4e97-3248-474d-83b5-cfac3109caf4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:28.981332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f4e97-3248-474d-83b5-cfac3109caf4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:28.983489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f4e97-3248-474d-83b5-cfac3109caf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.030616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:29.038767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-155f4e97-3248-474d-83b5-cfac3109caf4 None None] MFA Rules not processed for user `a789579f4c364938bfc445030aad9c78`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:29.040285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-155f4e97-3248-474d-83b5-cfac3109caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:29.059219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddc6fb-9cd8-4b7b-8a8b-ca8bbc843ae9 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.123935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:29.138974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.139893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.141031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.141356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.150322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 796/1615] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:29.151885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c923014-c9b2-4056-a59d-2e77e7fbfdd5 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.152244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c923014-c9b2-4056-a59d-2e77e7fbfdd5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.152596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c923014-c9b2-4056-a59d-2e77e7fbfdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.186879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7c923014-c9b2-4056-a59d-2e77e7fbfdd5 None None] MFA Rules not processed for user `aca0168b829f466c8fdfe10a7be46066`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:29.188200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7c923014-c9b2-4056-a59d-2e77e7fbfdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:29.257443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.259830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.289344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 797/1616] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:29.289344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c923014-c9b2-4056-a59d-2e77e7fbfdd5 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.297402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 820/1617] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:29.298399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.302052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c923014-c9b2-4056-a59d-2e77e7fbfdd5 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.308329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.309383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.309805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.310214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.310990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.313790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.322791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33cc31-e53a-47ab-b390-79e232aafa9b service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.330498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca9c16-cd7c-4a94-9b4e-9f5d59481207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.331306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9c16-cd7c-4a94-9b4e-9f5d59481207 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.331632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9c16-cd7c-4a94-9b4e-9f5d59481207 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.331916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9c16-cd7c-4a94-9b4e-9f5d59481207 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.332597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca9c16-cd7c-4a94-9b4e-9f5d59481207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.334697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca9c16-cd7c-4a94-9b4e-9f5d59481207 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.443145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 798/1618] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:29 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:29.444517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.471486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 821/1619] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:29 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:29.474368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2609f3-f4c6-4410-89b1-f08d40467cca None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.474979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2609f3-f4c6-4410-89b1-f08d40467cca None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.475410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2609f3-f4c6-4410-89b1-f08d40467cca None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.477465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 822/1620] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 1 15:58:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:58:29.478514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2609f3-f4c6-4410-89b1-f08d40467cca None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.492974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2609f3-f4c6-4410-89b1-f08d40467cca None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.500270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.501453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.501937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.503249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.505294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.507448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.522301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 823/1621] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:29.523488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.539945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae9df-0326-4dc4-aa3c-dcb63cc7daec admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.541293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda052b-ed06-4606-aa6e-ea18d79c4dd4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.545966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.546170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483549b0-1026-4242-bad2-14240c7d1187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.546715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.546845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483549b0-1026-4242-bad2-14240c7d1187 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.547078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483549b0-1026-4242-bad2-14240c7d1187 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.547246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.547508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483549b0-1026-4242-bad2-14240c7d1187 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.547707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.548212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483549b0-1026-4242-bad2-14240c7d1187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.550063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483549b0-1026-4242-bad2-14240c7d1187 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.562965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.564814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.573978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 824/1622] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:29.576553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 799/1623] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:29.578098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4bdb-3267-40cf-838e-9f52070e604a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.578985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4bdb-3267-40cf-838e-9f52070e604a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.579483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4bdb-3267-40cf-838e-9f52070e604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.588469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.615850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f7fd4-5f21-4cf7-81d9-ab4191c4cf3b service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.634219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.635447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.635719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.636013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] PATH_INFO: `/v3/projects/fd1156fbe6a84c1eacbfae6e5c95a903/users/854e6504e75b49eea60681eaf8083698/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.668627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d23b4bdb-3267-40cf-838e-9f52070e604a None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:29.669733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d23b4bdb-3267-40cf-838e-9f52070e604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:29.671295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1156fbe6a84c1eacbfae6e5c95a903, user_id=854e6504e75b49eea60681eaf8083698, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.676140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.760354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:29.782056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 825/1624] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 1 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:29.786350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4bdb-3267-40cf-838e-9f52070e604a None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.810809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4bdb-3267-40cf-838e-9f52070e604a None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:29.829074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:29.830268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:29.830783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:29.831222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] PATH_INFO: `/v3/projects/aa3d0e8fad1240169ec63ce6c69d3665/users/f69580a4665d44b8bf30a2fe6870e45f/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:29.856700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 800/1625] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:29 2022] PUT /identity/v3/projects/fd1156fbe6a84c1eacbfae6e5c95a903/users/854e6504e75b49eea60681eaf8083698/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:29.857684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:29.862710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3d0e8fad1240169ec63ce6c69d3665, user_id=f69580a4665d44b8bf30a2fe6870e45f, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:29.866133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:29.951696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 826/1626] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:29 2022] PUT /identity/v3/projects/aa3d0e8fad1240169ec63ce6c69d3665/users/f69580a4665d44b8bf30a2fe6870e45f/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:29.953209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:30.013750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca624432-2c19-41df-9a58-d24b4e60cd23 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:30.110949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd25d3-b194-49a3-bf19-50d064202785 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:30.123957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:30.124733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.125072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.125272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.126203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:30.128780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:30.138079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:30.138894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.140381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.140979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.171162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 827/1627] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:30.175674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:30.189132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96844270-aaec-4bee-aa71-decc4795c3da admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:30.197124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:30.213637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:30.217252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.217572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.217859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.218579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:30.224703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:30.252343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 828/1628] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:30.253920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:30.262650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:30.264581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:30.278773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899426-e745-46ad-a95c-f3edfcfeb8fb admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:30.293366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc522-5273-4a91-be6c-121a6bb64e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:30.294199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc522-5273-4a91-be6c-121a6bb64e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.294516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc522-5273-4a91-be6c-121a6bb64e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.295406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc522-5273-4a91-be6c-121a6bb64e8e admin admin] PATH_INFO: `/v3/projects/fd1156fbe6a84c1eacbfae6e5c95a903/users/854e6504e75b49eea60681eaf8083698/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.295869 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 801/1629] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:30.296855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:30.297510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc522-5273-4a91-be6c-121a6bb64e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1156fbe6a84c1eacbfae6e5c95a903, user_id=854e6504e75b49eea60681eaf8083698, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:30.302887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc522-5273-4a91-be6c-121a6bb64e8e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:30.668633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e26b-462d-4980-bdbc-e33b8c1753c4 service nova] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:30.672786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 829/1630] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:30 2022] PUT /identity/v3/projects/fd1156fbe6a84c1eacbfae6e5c95a903/users/854e6504e75b49eea60681eaf8083698/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:30.672786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6057c-0e11-4cd8-a2b4-53f92a4629e7 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.672786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6057c-0e11-4cd8-a2b4-53f92a4629e7 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.672786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6057c-0e11-4cd8-a2b4-53f92a4629e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.672786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e6f6057c-0e11-4cd8-a2b4-53f92a4629e7 None None] MFA Rules not processed for user `854e6504e75b49eea60681eaf8083698`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:30.675226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e6f6057c-0e11-4cd8-a2b4-53f92a4629e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:30.675592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d2d2-54c2-4c67-a7cf-c7b0f58b4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:30.675592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d2d2-54c2-4c67-a7cf-c7b0f58b4dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.675592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d2d2-54c2-4c67-a7cf-c7b0f58b4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.675592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d2d2-54c2-4c67-a7cf-c7b0f58b4dd6 admin admin] PATH_INFO: `/v3/projects/aa3d0e8fad1240169ec63ce6c69d3665/users/f69580a4665d44b8bf30a2fe6870e45f/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.675934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d2d2-54c2-4c67-a7cf-c7b0f58b4dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3d0e8fad1240169ec63ce6c69d3665, user_id=f69580a4665d44b8bf30a2fe6870e45f, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:30.675934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d2d2-54c2-4c67-a7cf-c7b0f58b4dd6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:30.675934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 802/1631] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:30 2022] PUT /identity/v3/projects/aa3d0e8fad1240169ec63ce6c69d3665/users/f69580a4665d44b8bf30a2fe6870e45f/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:30.675934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ff06-95b8-4839-a24b-66663339794f None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.675934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ff06-95b8-4839-a24b-66663339794f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.675934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ff06-95b8-4839-a24b-66663339794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.676349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 830/1632] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:30.676349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6057c-0e11-4cd8-a2b4-53f92a4629e7 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:30.676553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-19e8ff06-95b8-4839-a24b-66663339794f None None] MFA Rules not processed for user `f69580a4665d44b8bf30a2fe6870e45f`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:30.676553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-19e8ff06-95b8-4839-a24b-66663339794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:30.676757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6057c-0e11-4cd8-a2b4-53f92a4629e7 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:30.699036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 803/1633] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:30.735077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:30.735869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.736284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.736672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.803084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:30.804581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:30.806148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12524d49-707a-40f3-b549-be76ef93ac13 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.806447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12524d49-707a-40f3-b549-be76ef93ac13 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.806727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12524d49-707a-40f3-b549-be76ef93ac13 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.808350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 804/1634] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 1 15:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 15:58:30.813667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091edaa9-e9ef-4f40-af72-d97680487dc9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:30.813953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091edaa9-e9ef-4f40-af72-d97680487dc9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:30.814229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091edaa9-e9ef-4f40-af72-d97680487dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:30.816610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 831/1635] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:30.834018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-091edaa9-e9ef-4f40-af72-d97680487dc9 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:30.852015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-091edaa9-e9ef-4f40-af72-d97680487dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:30.901433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 805/1636] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:58:30.998851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:31.016034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47588-8f88-450f-b253-cfc750fb61ad service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:31.030505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:31.031692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:31.032076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:31.032364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:31.052638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:31.054286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:31.087064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091edaa9-e9ef-4f40-af72-d97680487dc9 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:31.106441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091edaa9-e9ef-4f40-af72-d97680487dc9 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:31.119517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 832/1637] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:31.121800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f2af-9218-4ccf-bbed-eecabb65ab38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:31.122865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f2af-9218-4ccf-bbed-eecabb65ab38 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:31.123170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f2af-9218-4ccf-bbed-eecabb65ab38 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:31.123459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f2af-9218-4ccf-bbed-eecabb65ab38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:31.156039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f2af-9218-4ccf-bbed-eecabb65ab38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:31.157996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f2af-9218-4ccf-bbed-eecabb65ab38 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:31.172193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 806/1638] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:58:31.211922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:31.751308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:31.755757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b9873-787d-4e30-8a61-49c32670f980 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:31.770323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824293c-d9b5-43ea-b758-604676283b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:31.772215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824293c-d9b5-43ea-b758-604676283b68 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:31.772653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824293c-d9b5-43ea-b758-604676283b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:31.773225 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824293c-d9b5-43ea-b758-604676283b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:31.872718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824293c-d9b5-43ea-b758-604676283b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:31.874283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824293c-d9b5-43ea-b758-604676283b68 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:31.887300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 833/1639] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:31.897228 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:32.952303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613de6a-750d-4db3-ac8f-773fadfebf63 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:32.952985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613de6a-750d-4db3-ac8f-773fadfebf63 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:32.952985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613de6a-750d-4db3-ac8f-773fadfebf63 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:32.955174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 807/1640] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 1 15:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:58:32.977060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a940a-3f6c-429f-a30b-5a481ef09542 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:32.977060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a940a-3f6c-429f-a30b-5a481ef09542 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:32.977060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a940a-3f6c-429f-a30b-5a481ef09542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:32.986837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:33.022668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-462a940a-3f6c-429f-a30b-5a481ef09542 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:33.023928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-462a940a-3f6c-429f-a30b-5a481ef09542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:33.063472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 834/1641] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 1 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:33.071723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9cef6-d9be-4bad-ad38-d34d85430829 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:33.072020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9cef6-d9be-4bad-ad38-d34d85430829 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:33.072508 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9cef6-d9be-4bad-ad38-d34d85430829 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:33.077803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 808/1642] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 1 15:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:58:33.093188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcbbe-4d3d-4db2-a9b5-f4c614566611 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:33.093475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcbbe-4d3d-4db2-a9b5-f4c614566611 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:33.093944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcbbe-4d3d-4db2-a9b5-f4c614566611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:33.125915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-705bcbbe-4d3d-4db2-a9b5-f4c614566611 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:33.127154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-705bcbbe-4d3d-4db2-a9b5-f4c614566611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:33.154701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 835/1643] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 15:58:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:33.226573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9cef6-d9be-4bad-ad38-d34d85430829 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:33.243127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9cef6-d9be-4bad-ad38-d34d85430829 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:33.252094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8c0ec-a4b1-44b4-9780-60602c7394a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:33.252779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c0ec-a4b1-44b4-9780-60602c7394a3 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:33.255094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c0ec-a4b1-44b4-9780-60602c7394a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:33.255094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c0ec-a4b1-44b4-9780-60602c7394a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:33.281149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c0ec-a4b1-44b4-9780-60602c7394a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:33.282789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c0ec-a4b1-44b4-9780-60602c7394a3 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:33.314613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 809/1644] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:34.062212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcbbe-4d3d-4db2-a9b5-f4c614566611 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:34.310623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcbbe-4d3d-4db2-a9b5-f4c614566611 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:34.340873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:34.341629 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:34.341916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:34.342195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] PATH_INFO: `/v3/users/4de02bad21e240ae97f0092e39f782dd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:34.355074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de02bad21e240ae97f0092e39f782dd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:34.356194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: WARNING py.warnings [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:58:34.356194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: warnings.warn(msg) Aug 01 15:58:34.356194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: Aug 01 15:58:34.361836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:34.745119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de02bad21e240ae97f0092e39f782dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:34.746253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de02bad21e240ae97f0092e39f782dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:34.746882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de02bad21e240ae97f0092e39f782dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:34.767207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de02bad21e240ae97f0092e39f782dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:34.801182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de02bad21e240ae97f0092e39f782dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:34.902630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 836/1645] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:58:34 2022] DELETE /identity/v3/users/4de02bad21e240ae97f0092e39f782dd => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:34.907451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:34.908068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:34.908068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:34.960113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:34.961351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:35.114625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:35.139239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 810/1646] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:35.145925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:35.147400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:35.336592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba6a7-e465-4ba3-b682-54b214f3d05d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:35.341168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:35.341876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:35.342166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:35.342485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:35.355109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:35.356952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:35.370038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 837/1647] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:36.812783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:36.815407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:36.836117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159719e1-a00e-4a6d-b2ab-eff5dacde828 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:36.852822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:36.853863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:36.854376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:36.856288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] PATH_INFO: `/v3/projects/644fb4a0de044796858aabf5cdb2d886` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:36.860980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=644fb4a0de044796858aabf5cdb2d886)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:36.870744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: WARNING py.warnings [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:58:36.870744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: warnings.warn(msg) Aug 01 15:58:36.870744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: Aug 01 15:58:36.872493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:37.042119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644fb4a0de044796858aabf5cdb2d886', 'request_id': 'req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.049844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644fb4a0de044796858aabf5cdb2d886', 'request_id': 'req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.155209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644fb4a0de044796858aabf5cdb2d886', 'request_id': 'req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.183094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] The token cache is being invalidate because project 644fb4a0de044796858aabf5cdb2d886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:58:37.183966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.193913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.196890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 811/1648] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:58:36 2022] DELETE /identity/v3/projects/644fb4a0de044796858aabf5cdb2d886 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:37.202085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:37.215500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fb2e5-537e-4381-baf4-6282f25c591b service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:37.248534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:37.445884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:37.445884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:37.445884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:37.446368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] PATH_INFO: `/v3/users/f69580a4665d44b8bf30a2fe6870e45f` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:37.448198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69580a4665d44b8bf30a2fe6870e45f)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:37.450772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:37.637648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69580a4665d44b8bf30a2fe6870e45f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.642223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69580a4665d44b8bf30a2fe6870e45f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.659288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69580a4665d44b8bf30a2fe6870e45f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.668358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69580a4665d44b8bf30a2fe6870e45f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.687824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69580a4665d44b8bf30a2fe6870e45f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:37.813275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 838/1649] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:58:37 2022] DELETE /identity/v3/users/f69580a4665d44b8bf30a2fe6870e45f => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:38.749475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:38.751039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:38.778943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669262-477d-4cc4-b4dc-a2cbd42acd2a admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:38.988200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:38.989035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:38.989318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:38.989621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] PATH_INFO: `/v3/projects/aa3d0e8fad1240169ec63ce6c69d3665` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:38.991761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3d0e8fad1240169ec63ce6c69d3665)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:39.000026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:39.232494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3d0e8fad1240169ec63ce6c69d3665', 'request_id': 'req-6bda0248-7b30-484d-af52-b7d6e22efbaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.246504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3d0e8fad1240169ec63ce6c69d3665', 'request_id': 'req-6bda0248-7b30-484d-af52-b7d6e22efbaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.308315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3d0e8fad1240169ec63ce6c69d3665', 'request_id': 'req-6bda0248-7b30-484d-af52-b7d6e22efbaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.322005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:39.324419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:39.338413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] The token cache is being invalidate because project aa3d0e8fad1240169ec63ce6c69d3665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:58:39.338623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.345431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6bda0248-7b30-484d-af52-b7d6e22efbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.348591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 812/1650] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:58:38 2022] DELETE /identity/v3/projects/aa3d0e8fad1240169ec63ce6c69d3665 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:39.354799 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af89bb0-c5ae-45f6-932e-e1fa96b1ceda None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:39.355155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af89bb0-c5ae-45f6-932e-e1fa96b1ceda None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:39.355354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af89bb0-c5ae-45f6-932e-e1fa96b1ceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:39.365834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c828d-2a2d-48aa-aeca-e13d38464247 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:39.428902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7af89bb0-c5ae-45f6-932e-e1fa96b1ceda None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:39.430257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7af89bb0-c5ae-45f6-932e-e1fa96b1ceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:39.447750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:39.549323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:39.551467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:39.552038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:39.552907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] PATH_INFO: `/v3/users/aca0168b829f466c8fdfe10a7be46066` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:39.554960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca0168b829f466c8fdfe10a7be46066)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:39.584801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:39.630592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 813/1651] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:39.635735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2dff1-70f7-4fb9-b10e-86065ffa6707 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:39.636350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2dff1-70f7-4fb9-b10e-86065ffa6707 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:39.636805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2dff1-70f7-4fb9-b10e-86065ffa6707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:39.685155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4df2dff1-70f7-4fb9-b10e-86065ffa6707 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:39.693335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4df2dff1-70f7-4fb9-b10e-86065ffa6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:39.717313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 814/1652] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:39.720007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2dff1-70f7-4fb9-b10e-86065ffa6707 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:39.747039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2dff1-70f7-4fb9-b10e-86065ffa6707 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:39.767739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:39.769541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:39.770005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:39.771491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:39.774103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:39.774103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:39.777860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:39.836277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 815/1653] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:58:39.836455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:39.840103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:39.857673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca0168b829f466c8fdfe10a7be46066'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.858882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca0168b829f466c8fdfe10a7be46066'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.859688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca0168b829f466c8fdfe10a7be46066'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.882184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca0168b829f466c8fdfe10a7be46066'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:39.890811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72077eb8-d106-4153-a3d9-18b4e964f4ad admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:39.912022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:39.913031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:39.914455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:39.915491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:39.920626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:39.925542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:39.929111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-59fdd01c-aef3-4d68-987c-534f9b5745d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca0168b829f466c8fdfe10a7be46066'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:40.029050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 839/1654] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:58:39 2022] DELETE /identity/v3/users/aca0168b829f466c8fdfe10a7be46066 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:40.033454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.034010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.034514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.071942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:40.073659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:40.115913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 816/1655] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:39 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:40.120754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:40.122848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:40.198079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 840/1656] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:40.243375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:40.245428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:40.282545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101cbcd-3bc0-46df-81e0-c035487f53fd admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:40.303670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:40.304267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.304555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.304828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.305537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:40.307542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:40.399985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293ba48-7a36-434c-b0b9-add01d01d717 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:40.423982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 817/1657] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:40 2022] POST /identity/v3/users => generated 286 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:58:40.435446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:40.449284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c33ae-bf33-4638-ab05-6afc7f6ec4d0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:40.463594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:40.464062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.464345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.464672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.465384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:40.468624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:40.501586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 818/1658] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:58:40.507639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:40.517606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:40.518220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.518496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.519455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.538657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:40.540382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:40.563040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 841/1659] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:58:40.565090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a85ee8-ed73-4d4d-b404-0eadc3de2043 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:40.590426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20bfb-5bcb-4a60-8556-86ef6e7dcc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:40.592011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20bfb-5bcb-4a60-8556-86ef6e7dcc02 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.592764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20bfb-5bcb-4a60-8556-86ef6e7dcc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.593276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20bfb-5bcb-4a60-8556-86ef6e7dcc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.595957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20bfb-5bcb-4a60-8556-86ef6e7dcc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:40.604489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20bfb-5bcb-4a60-8556-86ef6e7dcc02 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:40.666280 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 819/1660] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:40.670415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:40.684170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b25b1-3750-4060-97c5-12655ff392a1 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:40.692376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ba363-0692-4a40-bdaa-b771f27746b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:40.693386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba363-0692-4a40-bdaa-b771f27746b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.694676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba363-0692-4a40-bdaa-b771f27746b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.694965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba363-0692-4a40-bdaa-b771f27746b0 admin admin] PATH_INFO: `/v3/projects/ee5bded0dc3446d1aa3c0f48b6b44d66/users/0e2fedcfed594fb0a1230b6405e0aabd/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.703130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.703451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.704805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.742810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ba363-0692-4a40-bdaa-b771f27746b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5bded0dc3446d1aa3c0f48b6b44d66, user_id=0e2fedcfed594fb0a1230b6405e0aabd, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:40.746500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ba363-0692-4a40-bdaa-b771f27746b0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:40.758535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] MFA Rules not processed for user `df9d84db168a4612be9e98681d12bcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:40.760376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:40.809117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:40.877259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 820/1661] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:40.902745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 842/1662] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:40 2022] PUT /identity/v3/projects/ee5bded0dc3446d1aa3c0f48b6b44d66/users/0e2fedcfed594fb0a1230b6405e0aabd/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:58:40.907731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:40.909883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:40.917427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.917746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.918054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.991976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] MFA Rules not processed for user `0e2fedcfed594fb0a1230b6405e0aabd`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:41.002667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:41.104909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 843/1663] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:58:41.113575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:41.115381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:41.130111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06f7ad-5a34-4994-81bc-d313932df192 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:41.276501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77611719-fba1-4d8b-b3ce-83ecf6a77af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:41.277155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611719-fba1-4d8b-b3ce-83ecf6a77af6 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:41.277449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611719-fba1-4d8b-b3ce-83ecf6a77af6 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:41.278023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611719-fba1-4d8b-b3ce-83ecf6a77af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:41.290662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516119-dc51-4ab8-8e6b-04f13b2777d8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:41.301724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:41.302452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:41.304123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:41.304488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:41.328327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:41.332260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:41.361119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 844/1664] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:58:41.387188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:41.406561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77611719-fba1-4d8b-b3ce-83ecf6a77af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:41.408371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77611719-fba1-4d8b-b3ce-83ecf6a77af6 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:41.436449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 821/1665] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:41.543411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d796b7-a12f-4b14-9434-7fe39f3c5b9c service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:41.549983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:41.552024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:41.553453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:41.553843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] PATH_INFO: `/v3/users/0e2fedcfed594fb0a1230b6405e0aabd` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:41.555720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2fedcfed594fb0a1230b6405e0aabd)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:41.563065 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:41.703910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:41.823876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2fedcfed594fb0a1230b6405e0aabd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:41.827405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2fedcfed594fb0a1230b6405e0aabd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:41.830188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2fedcfed594fb0a1230b6405e0aabd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:41.845200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2fedcfed594fb0a1230b6405e0aabd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:41.892221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2fedcfed594fb0a1230b6405e0aabd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:42.013305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 845/1666] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:58:41 2022] DELETE /identity/v3/users/0e2fedcfed594fb0a1230b6405e0aabd => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:42.016499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:42.017144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:42.017547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:42.042035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:42.043780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:42.073153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:42.073153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:42.166537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:42.222997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e180d-9293-427e-b71f-1b09dcc19b30 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:42.231271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:42.231271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:42.231271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:42.231271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] PATH_INFO: `/v3/projects/490886e1790b47cabee664f39fa2215a` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:42.235203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 822/1667] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:42.244701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=490886e1790b47cabee664f39fa2215a)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:42.244701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:42.304474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:42.307916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:42.476792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9aeff-47c5-4ca2-b82f-8ad21dfa78a1 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:42.477060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490886e1790b47cabee664f39fa2215a', 'request_id': 'req-b27f3e71-55a7-452b-9d14-a6f8edd093c1'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:42.507791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490886e1790b47cabee664f39fa2215a', 'request_id': 'req-b27f3e71-55a7-452b-9d14-a6f8edd093c1'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:42.603534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838e56e-36c2-483e-bebf-0237139664e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:42.610907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838e56e-36c2-483e-bebf-0237139664e9 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:42.610907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838e56e-36c2-483e-bebf-0237139664e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:42.610907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838e56e-36c2-483e-bebf-0237139664e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:42.629804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490886e1790b47cabee664f39fa2215a', 'request_id': 'req-b27f3e71-55a7-452b-9d14-a6f8edd093c1'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:42.655341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] The token cache is being invalidate because project 490886e1790b47cabee664f39fa2215a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:58:42.657078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:42.658113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b27f3e71-55a7-452b-9d14-a6f8edd093c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:42.665577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 846/1668] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:58:42 2022] DELETE /identity/v3/projects/490886e1790b47cabee664f39fa2215a => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:42.670917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4540dd-0dcf-4ac5-a62c-fc05438f0fdb None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:42.671150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4540dd-0dcf-4ac5-a62c-fc05438f0fdb None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:42.671430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4540dd-0dcf-4ac5-a62c-fc05438f0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:42.741958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4c4540dd-0dcf-4ac5-a62c-fc05438f0fdb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:42.746597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4c4540dd-0dcf-4ac5-a62c-fc05438f0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:42.805211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838e56e-36c2-483e-bebf-0237139664e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:42.809014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838e56e-36c2-483e-bebf-0237139664e9 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:42.849875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 823/1669] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:42.990662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 847/1670] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:43.000794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d67aa-6efd-4111-a1d3-a346c9f9d530 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:43.001082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d67aa-6efd-4111-a1d3-a346c9f9d530 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:43.001361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d67aa-6efd-4111-a1d3-a346c9f9d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:43.053016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-793d67aa-6efd-4111-a1d3-a346c9f9d530 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:43.054955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-793d67aa-6efd-4111-a1d3-a346c9f9d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:43.085372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 824/1671] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:43.089950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4540dd-0dcf-4ac5-a62c-fc05438f0fdb None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:43.117594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4540dd-0dcf-4ac5-a62c-fc05438f0fdb None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:43.133929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:43.134699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:43.134993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:43.135271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:43.135984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:43.136291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:43.138140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:43.196411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 848/1672] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:43.205532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d67aa-6efd-4111-a1d3-a346c9f9d530 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:43.220162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:43.232749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d67aa-6efd-4111-a1d3-a346c9f9d530 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:43.273276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b3edd-8cc7-4dcb-a2a5-0a74d2ec31a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:43.282107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b3edd-8cc7-4dcb-a2a5-0a74d2ec31a6 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:43.282621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b3edd-8cc7-4dcb-a2a5-0a74d2ec31a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:43.283249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b3edd-8cc7-4dcb-a2a5-0a74d2ec31a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:43.284089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b3edd-8cc7-4dcb-a2a5-0a74d2ec31a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:43.287034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b3edd-8cc7-4dcb-a2a5-0a74d2ec31a6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:43.475530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 825/1673] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:43 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:43.486396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:43.509433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1451f-9bde-474f-bc9d-c2eb31b67792 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:43.632922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:43.633697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:43.633876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:43.634150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:43.634825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:43.636933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:43.725374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c72d-dd32-434b-a102-7ba07c602591 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:43.725872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c72d-dd32-434b-a102-7ba07c602591 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:43.726833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c72d-dd32-434b-a102-7ba07c602591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:43.776410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c8e2c72d-dd32-434b-a102-7ba07c602591 None None] MFA Rules not processed for user `debe5286d7c344de97c61686195507ee`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:43.778293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c8e2c72d-dd32-434b-a102-7ba07c602591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:43.787998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 849/1674] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:43 2022] POST /identity/v3/users => generated 283 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:43.789255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:43.804149 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:43.838260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dc037-b579-442e-82fe-d924e175945b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:43.862301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:43.863521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:43.863808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:43.864083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:43.864789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:43.870911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:43.947802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 850/1675] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:43.948612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:43.968230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 826/1676] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:58:43.968230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c72d-dd32-434b-a102-7ba07c602591 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:43.968641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:43.996299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c72d-dd32-434b-a102-7ba07c602591 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:44.005407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67180-605b-41cd-9570-dc7ec697eac9 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:44.013706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7abcf-7c71-436b-8cc5-44961e2bc4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:44.014353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7abcf-7c71-436b-8cc5-44961e2bc4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:44.014636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7abcf-7c71-436b-8cc5-44961e2bc4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:44.014910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7abcf-7c71-436b-8cc5-44961e2bc4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:44.015342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:44.015616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7abcf-7c71-436b-8cc5-44961e2bc4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:44.016476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:44.016951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:44.017416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] PATH_INFO: `/v3/users/a789579f4c364938bfc445030aad9c78` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:44.017919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7abcf-7c71-436b-8cc5-44961e2bc4d7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:44.020697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a789579f4c364938bfc445030aad9c78)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:44.024248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:44.036375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 827/1677] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:44.037726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695805c7-783b-47bf-9df1-e688403fd096 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:44.038016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695805c7-783b-47bf-9df1-e688403fd096 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:44.038330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695805c7-783b-47bf-9df1-e688403fd096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:44.085873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-695805c7-783b-47bf-9df1-e688403fd096 None None] MFA Rules not processed for user `debe5286d7c344de97c61686195507ee`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:44.087117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-695805c7-783b-47bf-9df1-e688403fd096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:44.107989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 828/1678] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:44.107989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695805c7-783b-47bf-9df1-e688403fd096 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:44.133134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695805c7-783b-47bf-9df1-e688403fd096 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:44.142302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:44.143088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:44.143521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:44.146300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] PATH_INFO: `/v3/projects/bfdd32f053f74c4a946029934b7b6b0e/users/04ca26e246f741eebe494ab62139e79f/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:44.171044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdd32f053f74c4a946029934b7b6b0e, user_id=04ca26e246f741eebe494ab62139e79f, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:44.174263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:44.280620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 829/1679] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:44 2022] PUT /identity/v3/projects/bfdd32f053f74c4a946029934b7b6b0e/users/04ca26e246f741eebe494ab62139e79f/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:44.280620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:44.293279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:44.309784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a789579f4c364938bfc445030aad9c78'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:44.310840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a789579f4c364938bfc445030aad9c78'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:44.311795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a789579f4c364938bfc445030aad9c78'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:44.340201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a789579f4c364938bfc445030aad9c78'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:44.424915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f05d070b-e920-4ffc-98d6-935d35bc5008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a789579f4c364938bfc445030aad9c78'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:44.489510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b660292-1f08-4f22-8acb-5b47d189aeeb admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:44.507677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b1fec-89f6-4480-b4c2-58d3291135ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:44.508391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1fec-89f6-4480-b4c2-58d3291135ca service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:44.508692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1fec-89f6-4480-b4c2-58d3291135ca service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:44.513727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1fec-89f6-4480-b4c2-58d3291135ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:44.516178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-356b1fec-89f6-4480-b4c2-58d3291135ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:44.560931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 851/1680] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:58:43 2022] DELETE /identity/v3/users/a789579f4c364938bfc445030aad9c78 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:44.563616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:44.564733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:44.564733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:44.587810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:44.648378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] MFA Rules not processed for user `04ca26e246f741eebe494ab62139e79f`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:44.651462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:44.688102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b1fec-89f6-4480-b4c2-58d3291135ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:44.689802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b1fec-89f6-4480-b4c2-58d3291135ca service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:44.723058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 830/1681] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:44.724901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:44.725201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:44.725476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:44.766151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:44.768196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:44.872272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 852/1682] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:44.877343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:44.882721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:44.917495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 831/1683] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:44.929946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:44.931751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:45.039182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d8caa-0fa1-4355-a004-c697cc5197c8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:45.044736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:45.045485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:45.045982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:45.046330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:45.060831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:45.063012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:45.080000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 832/1684] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:45.103150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:45.110614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:45.140071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ba6be-d44a-41a3-9ada-e89c851cd3ac service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:45.160646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46354ba-b7fd-4c1c-945f-155f60c1fb30 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:45.161050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:45.162421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:45.162715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:45.167593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] PATH_INFO: `/v3/projects/ee5bded0dc3446d1aa3c0f48b6b44d66` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:45.174548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5bded0dc3446d1aa3c0f48b6b44d66)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:45.177173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:45.178385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:45.179378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:45.179673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:45.179954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:45.182571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:45.187706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:45.370262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 853/1685] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:44 2022] POST /identity/v3/projects => generated 365 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:45.381306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:45.437810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5bded0dc3446d1aa3c0f48b6b44d66', 'request_id': 'req-732e542b-7a45-4d46-abd4-4d1e329d739d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:45.452534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5bded0dc3446d1aa3c0f48b6b44d66', 'request_id': 'req-732e542b-7a45-4d46-abd4-4d1e329d739d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:45.452967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:45.535214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ced660-0b95-4338-836a-9ebf4e2467cc admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:45.545159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5bded0dc3446d1aa3c0f48b6b44d66', 'request_id': 'req-732e542b-7a45-4d46-abd4-4d1e329d739d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:45.583365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] The token cache is being invalidate because project ee5bded0dc3446d1aa3c0f48b6b44d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:58:45.583883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:45.585328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-732e542b-7a45-4d46-abd4-4d1e329d739d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:45.587943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 833/1686] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:58:45 2022] DELETE /identity/v3/projects/ee5bded0dc3446d1aa3c0f48b6b44d66 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:45.600790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:45.609491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea271ad3-204c-4ba9-a557-bbbc2c1a8aac None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:45.610575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea271ad3-204c-4ba9-a557-bbbc2c1a8aac None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:45.610870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea271ad3-204c-4ba9-a557-bbbc2c1a8aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:45.723252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ea271ad3-204c-4ba9-a557-bbbc2c1a8aac None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:45.725916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ea271ad3-204c-4ba9-a557-bbbc2c1a8aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:45.753482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:45.758258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:45.759835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:45.760350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:45.762206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:45.776808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:45.884139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 854/1687] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:45 2022] POST /identity/v3/users => generated 289 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:45.887795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:45.893003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:45.923464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2c541-06f6-4e7c-b0b1-e0490c4384ab admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:45.944003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:45.944732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:45.944941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:45.945293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:45.946043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:45.950307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:45.977237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 855/1688] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:45.978544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:46.006854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e23445-a642-4ab3-8c0e-aac25c28a7b0 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:46.015603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 834/1689] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:46.017849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872552cb-ec2a-4e35-bd9d-1f476f7182fb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.019499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:46.020407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.020407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.020820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] PATH_INFO: `/v3/projects/6a834872b19a488d98bf2a5dc6a8e043/users/f49c390aa7094870a7d578b7292bf70c/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.021113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872552cb-ec2a-4e35-bd9d-1f476f7182fb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.021588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872552cb-ec2a-4e35-bd9d-1f476f7182fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.068132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-872552cb-ec2a-4e35-bd9d-1f476f7182fb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:46.070994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-872552cb-ec2a-4e35-bd9d-1f476f7182fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:46.077695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a834872b19a488d98bf2a5dc6a8e043, user_id=f49c390aa7094870a7d578b7292bf70c, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:46.082437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 835/1690] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:46.084133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bceb72-034c-4a68-b6a4-a4b15e6156dc None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.084807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bceb72-034c-4a68-b6a4-a4b15e6156dc None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.085354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bceb72-034c-4a68-b6a4-a4b15e6156dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.098757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:46.155586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-76bceb72-034c-4a68-b6a4-a4b15e6156dc None None] MFA Rules not processed for user `2c1113cbce924ad9b68690db65c58232`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:46.156833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-76bceb72-034c-4a68-b6a4-a4b15e6156dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:46.236224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 856/1691] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:45 2022] PUT /identity/v3/projects/6a834872b19a488d98bf2a5dc6a8e043/users/f49c390aa7094870a7d578b7292bf70c/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:46.237258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:46.265874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 836/1692] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:46.267884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c85b-41eb-4dbb-9cfd-4ff846cfeb74 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.268365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c85b-41eb-4dbb-9cfd-4ff846cfeb74 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.268895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c85b-41eb-4dbb-9cfd-4ff846cfeb74 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.271135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 837/1693] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 1 15:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:58:46.272260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57c85b-41eb-4dbb-9cfd-4ff846cfeb74 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:46.408913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e756e-22b4-404d-82f3-e0778db7bae1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:46.431939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:46.433022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.433420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.433847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.434925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:46.435340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:46.437183 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:46.452273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57c85b-41eb-4dbb-9cfd-4ff846cfeb74 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:46.473276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 857/1694] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:46.474909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:46.484026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:46.488284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add86b75-d22e-4c05-b55f-0e5ee1f2dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:46.488935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86b75-d22e-4c05-b55f-0e5ee1f2dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.489220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86b75-d22e-4c05-b55f-0e5ee1f2dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.489497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86b75-d22e-4c05-b55f-0e5ee1f2dc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.490352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add86b75-d22e-4c05-b55f-0e5ee1f2dc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:46.491997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add86b75-d22e-4c05-b55f-0e5ee1f2dc00 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:46.519926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 838/1695] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:46.521252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d274-c4ea-46a7-9980-df33945213b7 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.521720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d274-c4ea-46a7-9980-df33945213b7 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.521868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d274-c4ea-46a7-9980-df33945213b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.642842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4df8d274-c4ea-46a7-9980-df33945213b7 None None] MFA Rules not processed for user `90399c6cab2341f1af74d154c819bff9`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:46.645891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00efe1-06ec-4e58-afa9-7a99f6cffb4a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:46.652464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:46.652885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4df8d274-c4ea-46a7-9980-df33945213b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:46.653725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.654356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.654882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.766155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 839/1696] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:46.767907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8d274-c4ea-46a7-9980-df33945213b7 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:46.787499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:46.790068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:46.794325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8d274-c4ea-46a7-9980-df33945213b7 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:46.801711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:46.802468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.802826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.804627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.805382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:46.808062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 858/1697] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:46.808898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:46.809256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:46.836133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679e13-eeca-4d43-9164-115ca63ef3f2 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:46.844557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4014-3258-4a63-b8d5-52fdd3966f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:46.844557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4014-3258-4a63-b8d5-52fdd3966f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.844557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4014-3258-4a63-b8d5-52fdd3966f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.844934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4014-3258-4a63-b8d5-52fdd3966f79 admin admin] PATH_INFO: `/v3/projects/6a834872b19a488d98bf2a5dc6a8e043/users/f49c390aa7094870a7d578b7292bf70c/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.847559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4014-3258-4a63-b8d5-52fdd3966f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a834872b19a488d98bf2a5dc6a8e043, user_id=f49c390aa7094870a7d578b7292bf70c, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:46.853085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4014-3258-4a63-b8d5-52fdd3966f79 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:46.877541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 859/1698] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:46 2022] PUT /identity/v3/projects/6a834872b19a488d98bf2a5dc6a8e043/users/f49c390aa7094870a7d578b7292bf70c/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:46.880870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:46.881173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:46.881457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:46.919494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 840/1699] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:46 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:46.924021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:46.925623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:46.985934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] MFA Rules not processed for user `1f30bfa8b6e2449493810c05754bf8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:46.987608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.120420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786eccb-ca86-4d7c-8908-d268875346ec admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:47.126163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:47.127009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.128825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.129507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] PATH_INFO: `/v3/projects/35956ef27743401c87e0b7332dee6880` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.132235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=35956ef27743401c87e0b7332dee6880)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:47.134593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:47.155599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 860/1700] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:47.156835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:47.158323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.232798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97bf4d-70e1-453f-9bf1-27d0d6b3d4d0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:47.236788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5ecf3-3eab-4ad1-a847-1082e019da33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:47.237567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5ecf3-3eab-4ad1-a847-1082e019da33 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.239073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5ecf3-3eab-4ad1-a847-1082e019da33 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.239073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5ecf3-3eab-4ad1-a847-1082e019da33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.247113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5ecf3-3eab-4ad1-a847-1082e019da33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:47.248743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5ecf3-3eab-4ad1-a847-1082e019da33 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:47.259217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 861/1701] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:47.260571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eccea-f621-461f-ad76-c9956e5870bd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.260993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eccea-f621-461f-ad76-c9956e5870bd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.261380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eccea-f621-461f-ad76-c9956e5870bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.285948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35956ef27743401c87e0b7332dee6880', 'request_id': 'req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:47.287126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:47.294360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35956ef27743401c87e0b7332dee6880', 'request_id': 'req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:47.307517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a25eccea-f621-461f-ad76-c9956e5870bd None None] MFA Rules not processed for user `f49c390aa7094870a7d578b7292bf70c`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:47.309552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a25eccea-f621-461f-ad76-c9956e5870bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.400856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35956ef27743401c87e0b7332dee6880', 'request_id': 'req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:47.411740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:47.480061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] The token cache is being invalidate because project 35956ef27743401c87e0b7332dee6880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:58:47.480061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:47.480061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:47.480061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 841/1702] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:58:46 2022] DELETE /identity/v3/projects/35956ef27743401c87e0b7332dee6880 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:47.480061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:47.481308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.481430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 862/1703] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:47.481430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b18fab-4036-414d-9660-492b9b1706d2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.481430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b18fab-4036-414d-9660-492b9b1706d2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.481430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b18fab-4036-414d-9660-492b9b1706d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.485562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a1b18fab-4036-414d-9660-492b9b1706d2 None None] MFA Rules not processed for user `1f30bfa8b6e2449493810c05754bf8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:47.489598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a1b18fab-4036-414d-9660-492b9b1706d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.579768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 863/1704] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:47.582013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.582443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.582800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.615951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:47.618358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.631673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410b8bb-80fe-4282-a99b-ac6a9d4739ec admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:47.641129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 864/1705] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:47.641129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:47.641129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.647610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:47.648576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.649075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.649860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.650673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:47.653758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:47.741846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a363ef7-188b-43de-9308-b7e7bd093f25 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:47.749004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193ddf-8e68-4718-96e9-56ef9cf22534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:47.749720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193ddf-8e68-4718-96e9-56ef9cf22534 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.749983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193ddf-8e68-4718-96e9-56ef9cf22534 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.750330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193ddf-8e68-4718-96e9-56ef9cf22534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.754317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-58193ddf-8e68-4718-96e9-56ef9cf22534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.781094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193ddf-8e68-4718-96e9-56ef9cf22534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:47.783593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193ddf-8e68-4718-96e9-56ef9cf22534 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:47.830950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 842/1706] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:47 2022] POST /identity/v3/users => generated 292 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:47.833822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:47.837431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 865/1707] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:47.839634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10c9a-1047-4a9d-8b38-8fe89cb58d0f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.840860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.845121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10c9a-1047-4a9d-8b38-8fe89cb58d0f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.846476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10c9a-1047-4a9d-8b38-8fe89cb58d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.938025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e4f10c9a-1047-4a9d-8b38-8fe89cb58d0f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:47.938025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e4f10c9a-1047-4a9d-8b38-8fe89cb58d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:47.953418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 866/1708] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:47.954458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f10c9a-1047-4a9d-8b38-8fe89cb58d0f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:47.968384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f10c9a-1047-4a9d-8b38-8fe89cb58d0f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:47.986638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:47.996862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:47.996862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:47.996862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:47.996862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:47.996862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.052450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 867/1709] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:48.054189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:48.089064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9dd6-6093-47d8-88bc-0186ee14bec7 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.099156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.102959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.103127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.103358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.104375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:48.104696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:48.110768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.127259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb814a-adc1-499e-bb0f-982f32cd7ebe admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.147675 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.148383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.148853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.148968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.154331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:48.175210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 868/1710] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:48.175210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:48.178333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:48.179983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.206259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a3e3c-799c-4990-9211-831ff45490cd admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.208212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 843/1711] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:48.209230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:48.214503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:48.227751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcaaa0-ed21-44a9-8149-acec71205fe5 service nova] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.232741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.232741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.233015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.233111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.233111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.233244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.233244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.233381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:48.233454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.234907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.241938 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:48.274395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 869/1712] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:48.275370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:48.311334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1e734-35dc-4865-a66a-e2bdb618e966 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.336364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.336928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.337219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.337501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.338215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:48.340227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.364138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:48.460279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:48.466214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.477600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 844/1713] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:48.478566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:48.499302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 870/1714] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:48 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:48.501552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97ef4-ee98-438c-9b1a-de97e21187af service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.503812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:48.631358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92047475-d6e9-4751-b11b-9b8999e0442a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.642098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0236b-3e78-44cd-b96f-d1f8bf61c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.642995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0236b-3e78-44cd-b96f-d1f8bf61c0fd admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.643460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0236b-3e78-44cd-b96f-d1f8bf61c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.644256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0236b-3e78-44cd-b96f-d1f8bf61c0fd admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.644964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0236b-3e78-44cd-b96f-d1f8bf61c0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:48.649843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0236b-3e78-44cd-b96f-d1f8bf61c0fd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.657082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826fd0-6308-400e-b518-0928a7be3bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.657082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826fd0-6308-400e-b518-0928a7be3bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.657082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826fd0-6308-400e-b518-0928a7be3bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.657082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826fd0-6308-400e-b518-0928a7be3bd8 admin admin] PATH_INFO: `/v3/projects/68f47873153646c48edd017be882b933/users/ffae499b43704e49ad470802505cb4b0/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.684243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826fd0-6308-400e-b518-0928a7be3bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f47873153646c48edd017be882b933, user_id=ffae499b43704e49ad470802505cb4b0, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:48.684802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826fd0-6308-400e-b518-0928a7be3bd8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:48.790674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 871/1715] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:48 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:48.792086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61c93b-2762-4235-935b-41dd57812adc None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.792359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61c93b-2762-4235-935b-41dd57812adc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.792642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61c93b-2762-4235-935b-41dd57812adc None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.796916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 872/1716] 10.222.0.77 () {54 vars in 961 bytes} [Mon Aug 1 15:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:58:48.797757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61c93b-2762-4235-935b-41dd57812adc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:48.803171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 845/1717] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:48 2022] PUT /identity/v3/projects/68f47873153646c48edd017be882b933/users/ffae499b43704e49ad470802505cb4b0/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:48.804948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b90e4-85f4-455b-a7bd-1fe47d8f5db6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.805411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b90e4-85f4-455b-a7bd-1fe47d8f5db6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.805600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b90e4-85f4-455b-a7bd-1fe47d8f5db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.839705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f85b90e4-85f4-455b-a7bd-1fe47d8f5db6 None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:48.843681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f85b90e4-85f4-455b-a7bd-1fe47d8f5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:48.964814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61c93b-2762-4235-935b-41dd57812adc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:48.993910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:48.995156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:48.995815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:48.996346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:48.997933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:49.001200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:49.002199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 846/1718] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Aug 1 15:58:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:49.013591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173f45-ff56-474d-ab2d-101a8e198446 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.013591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173f45-ff56-474d-ab2d-101a8e198446 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.013591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173f45-ff56-474d-ab2d-101a8e198446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.032404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 873/1719] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:49.034221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:49.063165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2e173f45-ff56-474d-ab2d-101a8e198446 None None] MFA Rules not processed for user `ffae499b43704e49ad470802505cb4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:49.064903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b850e7-ccbc-4aa3-b434-3374b8698ee1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:49.065037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2e173f45-ff56-474d-ab2d-101a8e198446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:49.080163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:49.082754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.083278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.083746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.086647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:49.113429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:49.113429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:49.125735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 874/1720] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:49.127373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:49.151987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcad70-812b-4db9-a50d-f9d6a7139b4c service placement] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:49.160317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:49.161930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.162208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.162487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.163462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:49.168899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:49.188982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 875/1721] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:49.193425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:49.213155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c67151-27e3-4c22-92e7-f43e8ac355eb admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:49.253236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841655-5c67-402d-874f-63c2a7b2c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:49.259313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841655-5c67-402d-874f-63c2a7b2c650 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.263649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841655-5c67-402d-874f-63c2a7b2c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.263983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841655-5c67-402d-874f-63c2a7b2c650 admin admin] PATH_INFO: `/v3/projects/35a0878818a5449f95e3189f484d00df/users/9eba6c93379d4d289ba304365d6aefa5/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.299325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 847/1722] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:49.301263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17822e4-1bad-4aae-9e8e-61caef014c21 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.301601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17822e4-1bad-4aae-9e8e-61caef014c21 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.301886 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17822e4-1bad-4aae-9e8e-61caef014c21 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.308553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 848/1723] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 1 15:58:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:58:49.311247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17822e4-1bad-4aae-9e8e-61caef014c21 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:49.312907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841655-5c67-402d-874f-63c2a7b2c650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a0878818a5449f95e3189f484d00df, user_id=9eba6c93379d4d289ba304365d6aefa5, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:49.324163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841655-5c67-402d-874f-63c2a7b2c650 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:49.431394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 876/1724] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:49 2022] PUT /identity/v3/projects/35a0878818a5449f95e3189f484d00df/users/9eba6c93379d4d289ba304365d6aefa5/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:49.437041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6788-567e-4bb8-aec6-a312732c23ce None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.437041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6788-567e-4bb8-aec6-a312732c23ce None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.437041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6788-567e-4bb8-aec6-a312732c23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.523276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17822e4-1bad-4aae-9e8e-61caef014c21 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:49.530017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-535f6788-567e-4bb8-aec6-a312732c23ce None None] MFA Rules not processed for user `90399c6cab2341f1af74d154c819bff9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:49.531961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-535f6788-567e-4bb8-aec6-a312732c23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:49.685508 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:49.686394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.686649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.686936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.699743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 877/1725] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:49.703796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:49.704126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:49.706103 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:49.803512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:49.817341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] MFA Rules not processed for user `9eba6c93379d4d289ba304365d6aefa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:49.823831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:49.923513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:49.928804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:49.991871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 849/1726] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:58:49.993555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:49.995922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:50.021671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 878/1727] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:50.031288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:50.033594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:50.042086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ac9b-da6e-45ad-ae8f-acf79bd50f78 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:50.048560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352b0e6-18d5-4852-945c-3c309b5475f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:50.049742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352b0e6-18d5-4852-945c-3c309b5475f7 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:50.050867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352b0e6-18d5-4852-945c-3c309b5475f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:50.051382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352b0e6-18d5-4852-945c-3c309b5475f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:50.072021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352b0e6-18d5-4852-945c-3c309b5475f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:50.076774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352b0e6-18d5-4852-945c-3c309b5475f7 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:50.104430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 850/1728] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:50.233752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9e344-d469-428e-83ce-97c1ec80b0aa None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:50.249305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a3677-0265-4de9-8536-bd55f551af2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:50.249691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3677-0265-4de9-8536-bd55f551af2e service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:50.249982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3677-0265-4de9-8536-bd55f551af2e service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:50.250616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3677-0265-4de9-8536-bd55f551af2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:50.264819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a3677-0265-4de9-8536-bd55f551af2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:50.274300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a3677-0265-4de9-8536-bd55f551af2e service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:50.325928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:50.335143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 879/1729] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:50.633388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aa621-6f8c-42c4-bca7-3f78adeecbed None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:50.634091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aa621-6f8c-42c4-bca7-3f78adeecbed None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:50.634683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aa621-6f8c-42c4-bca7-3f78adeecbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:50.690980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2b4aa621-6f8c-42c4-bca7-3f78adeecbed None None] MFA Rules not processed for user `df9d84db168a4612be9e98681d12bcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:50.694629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2b4aa621-6f8c-42c4-bca7-3f78adeecbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:50.904887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 851/1730] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:50.971155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:51.771791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:51.938353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe69129-32df-4107-b900-9fc58496cf10 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:51.938931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe69129-32df-4107-b900-9fc58496cf10 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:51.939024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe69129-32df-4107-b900-9fc58496cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:51.964978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-dbe69129-32df-4107-b900-9fc58496cf10 None None] MFA Rules not processed for user `1f30bfa8b6e2449493810c05754bf8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:51.966785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-dbe69129-32df-4107-b900-9fc58496cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:52.078699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 880/1731] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:52.126245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aa621-6f8c-42c4-bca7-3f78adeecbed None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:52.263289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aa621-6f8c-42c4-bca7-3f78adeecbed None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:52.272149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:52.273294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:52.273394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:52.274119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] PATH_INFO: `/v3/users/9eba6c93379d4d289ba304365d6aefa5` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:52.286179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eba6c93379d4d289ba304365d6aefa5)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:52.290943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:52.380035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ea09-dd81-4ac6-ad82-692ecb762e89 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:52.380825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ea09-dd81-4ac6-ad82-692ecb762e89 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:52.381258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ea09-dd81-4ac6-ad82-692ecb762e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:52.416341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d690ea09-dd81-4ac6-ad82-692ecb762e89 None None] MFA Rules not processed for user `2c1113cbce924ad9b68690db65c58232`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:52.417660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d690ea09-dd81-4ac6-ad82-692ecb762e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:52.527918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 881/1732] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:52.679153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eba6c93379d4d289ba304365d6aefa5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:52.702186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eba6c93379d4d289ba304365d6aefa5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:52.828255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eba6c93379d4d289ba304365d6aefa5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:52.830108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eba6c93379d4d289ba304365d6aefa5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:52.870298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eba6c93379d4d289ba304365d6aefa5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:52.879311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 852/1733] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:58:52 2022] DELETE /identity/v3/users/9eba6c93379d4d289ba304365d6aefa5 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:52.892608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:52.896957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:52.901217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:52.949211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:52.956654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:52.964993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:53.148789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 882/1734] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:53.163120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:53.163120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:53.445783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd845ad-f2f3-49e3-89ab-fbe14c2e6c99 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:53.461576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1069ae7-1116-4f3c-8206-79ed4f6d56b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:53.463795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069ae7-1116-4f3c-8206-79ed4f6d56b5 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:53.465605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069ae7-1116-4f3c-8206-79ed4f6d56b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:53.466125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1069ae7-1116-4f3c-8206-79ed4f6d56b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:53.497776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1069ae7-1116-4f3c-8206-79ed4f6d56b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:53.503088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1069ae7-1116-4f3c-8206-79ed4f6d56b5 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:53.575097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 853/1735] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:53.858020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:54.538017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:54.969223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:54.999106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:55.048679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e03b-dcd9-4b2a-9934-53a72b3a1ca6 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:55.073821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:55.077113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:55.077670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:55.082114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] PATH_INFO: `/v3/projects/35a0878818a5449f95e3189f484d00df` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:55.082114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a0878818a5449f95e3189f484d00df)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:55.087839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:55.240181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe11b-ce23-4925-b3a8-1f58387e3914 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:55.241155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe11b-ce23-4925-b3a8-1f58387e3914 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:55.241742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe11b-ce23-4925-b3a8-1f58387e3914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:55.322458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a0878818a5449f95e3189f484d00df', 'request_id': 'req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:55.354253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a0878818a5449f95e3189f484d00df', 'request_id': 'req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:55.410698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-42dfe11b-ce23-4925-b3a8-1f58387e3914 None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:55.411958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-42dfe11b-ce23-4925-b3a8-1f58387e3914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:55.471562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:55.508774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 854/1736] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:55.600590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a0878818a5449f95e3189f484d00df', 'request_id': 'req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:55.645889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] The token cache is being invalidate because project 35a0878818a5449f95e3189f484d00df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:58:55.646632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:55.649082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9ad87e92-4c40-4c19-9151-a07e2de4a1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:58:55.650852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 883/1737] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:58:54 2022] DELETE /identity/v3/projects/35a0878818a5449f95e3189f484d00df => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:55.656167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27279ddc-c69e-47cd-b2a3-9727ea9f89a3 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:55.656620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27279ddc-c69e-47cd-b2a3-9727ea9f89a3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:55.656936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27279ddc-c69e-47cd-b2a3-9727ea9f89a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:55.752668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-27279ddc-c69e-47cd-b2a3-9727ea9f89a3 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:55.758069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-27279ddc-c69e-47cd-b2a3-9727ea9f89a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:55.847369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 855/1738] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:55.854719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:55.855012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:55.855294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:55.885419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:55.887559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:55.899676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 884/1739] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:55.904145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27279ddc-c69e-47cd-b2a3-9727ea9f89a3 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:55.932507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27279ddc-c69e-47cd-b2a3-9727ea9f89a3 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:55.945544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:55.946570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:55.947410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:55.948284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:55.949212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:58:55.949718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:55.959051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:55.989074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 856/1740] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:58:55.989798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:55.991496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:55.993114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:56.004715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403370d-7e78-4171-88d1-bd7536d94113 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:56.010133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:56.027734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:56.027734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:56.027734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:56.027734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:56.027734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:56.081417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:56.123927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 857/1741] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:55 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:56.126586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:56.208132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642806d1-fe0f-4dab-82e6-bfe4106d9954 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:56.283347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6e69e-e5f9-4ad0-9709-a80383ca13d0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:56.292405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:56.293424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:56.293948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:56.294554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:56.296415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:56.299197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:56.435157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 858/1742] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:56 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:56.439218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:56.449997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a36e2-b8f7-4d53-9641-c855bc8dce66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:56.455141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a36e2-b8f7-4d53-9641-c855bc8dce66 service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:56.455141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a36e2-b8f7-4d53-9641-c855bc8dce66 service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:56.455141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a36e2-b8f7-4d53-9641-c855bc8dce66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:56.456651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e40a36e2-b8f7-4d53-9641-c855bc8dce66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:56.466517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eed52-9693-45cf-b87d-2449059bebdb admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:56.473831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:56.474685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:56.478258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:56.478258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:56.478258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:56.479085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:56.519119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 859/1743] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:58:56.523801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:56.554458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf699f-717b-4fd3-9e77-595e13731767 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:56.587346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:56.587981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:56.588275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:56.588556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:56.589772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:56.595939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:56.621005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 860/1744] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:58:56.622651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:56.633328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a36e2-b8f7-4d53-9641-c855bc8dce66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:56.634948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a36e2-b8f7-4d53-9641-c855bc8dce66 service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:56.653830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 885/1745] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 15:58:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:58:56.656408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f254930-7bf1-432d-9e83-87916141c2ed admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:56.671136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:56.672173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:56.672595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:56.672943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] PATH_INFO: `/v3/projects/0a318aba020547b3b7a5eb8f4c2a9f26/users/3e15b41cc8cf47e49665fc053827db61/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:56.697033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a318aba020547b3b7a5eb8f4c2a9f26, user_id=3e15b41cc8cf47e49665fc053827db61, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:56.699976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:56.807445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 861/1746] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:56 2022] PUT /identity/v3/projects/0a318aba020547b3b7a5eb8f4c2a9f26/users/3e15b41cc8cf47e49665fc053827db61/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:56.834127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca095-3647-4266-b970-cc3a1c6b1e69 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:56.834127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca095-3647-4266-b970-cc3a1c6b1e69 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:56.834393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ca095-3647-4266-b970-cc3a1c6b1e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:56.885822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5a5ca095-3647-4266-b970-cc3a1c6b1e69 None None] MFA Rules not processed for user `3e15b41cc8cf47e49665fc053827db61`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:56.887142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5a5ca095-3647-4266-b970-cc3a1c6b1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:57.047908 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 886/1747] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:58:57.052671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:57.158308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94b3a6-0cb7-428d-b439-b208cf0cb974 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:57.166844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:57.167722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:57.168113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:57.168454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:57.169217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:57.173768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:57.342596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 862/1748] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:58:57 2022] POST /identity/v3/projects => generated 405 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:57.346803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ca095-3647-4266-b970-cc3a1c6b1e69 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:57.370158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ca095-3647-4266-b970-cc3a1c6b1e69 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:57.466168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:57.551173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:57.551886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:57.552197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:57.552454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:57.562861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:57.564078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:57.664190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:57.693904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 887/1749] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:58:57 2022] POST /identity/v3/users => generated 309 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:58:57.697909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:57.726751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0798f-584a-442b-9b5b-210bdbf205af admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:57.769972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff99359-74ff-46f9-a3b8-5f73320323a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:57.772931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff99359-74ff-46f9-a3b8-5f73320323a5 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:57.773146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff99359-74ff-46f9-a3b8-5f73320323a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:57.775651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff99359-74ff-46f9-a3b8-5f73320323a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:57.777366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff99359-74ff-46f9-a3b8-5f73320323a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:57.839896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff99359-74ff-46f9-a3b8-5f73320323a5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:57.839896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 863/1750] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:57.850631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:57.920324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd99b-f183-4a91-bc4d-a98bf9104334 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:57.991820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:57.991820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:57.991820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:57.991820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] PATH_INFO: `/v3/projects/5b7f69096cf34c9fb8c028237ef5c48e/users/7a6455f9464a4140acc343b438696577/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:58.010674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7f69096cf34c9fb8c028237ef5c48e, user_id=7a6455f9464a4140acc343b438696577, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:58.023664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:58.265499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:58.266224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:58.266692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:58.348781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 888/1751] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:57 2022] PUT /identity/v3/projects/5b7f69096cf34c9fb8c028237ef5c48e/users/7a6455f9464a4140acc343b438696577/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:58.349201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] MFA Rules not processed for user `90399c6cab2341f1af74d154c819bff9`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:58.349201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:58.350035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:58.375855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:58.436048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 864/1752] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Aug 1 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:58:58.453457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:58.466490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:58.474385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1ed5-244d-409c-831b-007cd7dec2cf admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:58.482462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:58.483458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:58.484674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:58.485470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:58.486677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:58.489784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:58.506855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 889/1753] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:58:58.513609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:58.523434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e43cca-b2ef-478d-9017-eaa44ee1812c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:58.529702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fda9e-6b94-43fd-a750-19b3897a29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:58.530939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fda9e-6b94-43fd-a750-19b3897a29b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:58.531406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fda9e-6b94-43fd-a750-19b3897a29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:58.531791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fda9e-6b94-43fd-a750-19b3897a29b9 admin admin] PATH_INFO: `/v3/projects/5b7f69096cf34c9fb8c028237ef5c48e/users/7a6455f9464a4140acc343b438696577/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:58.535078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fda9e-6b94-43fd-a750-19b3897a29b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7f69096cf34c9fb8c028237ef5c48e, user_id=7a6455f9464a4140acc343b438696577, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:58.539605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fda9e-6b94-43fd-a750-19b3897a29b9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:58.540569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9705617-fef2-48d5-a3a9-8ad343ac599a None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:58.553365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 890/1754] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:58:58 2022] PUT /identity/v3/projects/5b7f69096cf34c9fb8c028237ef5c48e/users/7a6455f9464a4140acc343b438696577/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:58:58.584491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d7ecd-0820-4431-905e-c96104a30345 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:58.584491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d7ecd-0820-4431-905e-c96104a30345 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:58.584491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d7ecd-0820-4431-905e-c96104a30345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:58.636310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6c7d7ecd-0820-4431-905e-c96104a30345 None None] MFA Rules not processed for user `7a6455f9464a4140acc343b438696577`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:58:58.638031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6c7d7ecd-0820-4431-905e-c96104a30345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:58.766908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:58.771717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:58.772101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:58.772394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:58.857354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:58.867645 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:58.906902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 865/1755] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:58:58.932401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 891/1756] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:58:59.035722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:59.035722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:59.191805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:59.251756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034ca2-1f49-4cfe-865f-1c9b87a71df0 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:59.263807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:59.276475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:59.276764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:59.277049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:59.307226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:59.316352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:59.337116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 866/1757] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:58:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:59.629572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d7ecd-0820-4431-905e-c96104a30345 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:59.897060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d7ecd-0820-4431-905e-c96104a30345 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:59.935527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:59.935527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:59.935527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:59.935527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] PATH_INFO: `/v3/users/3e15b41cc8cf47e49665fc053827db61` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:59.942679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e15b41cc8cf47e49665fc053827db61)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:59.955795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:00.165683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:00.224654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:00.225952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:00.328446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e15b41cc8cf47e49665fc053827db61'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:00.337080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e15b41cc8cf47e49665fc053827db61'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:00.340609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e15b41cc8cf47e49665fc053827db61'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:00.360569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762bc0-0d7c-49a6-a0b0-65fdfdd2fa4f service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:00.389471 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e15b41cc8cf47e49665fc053827db61'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:00.390392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:00.400212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:00.402714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:00.405638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] PATH_INFO: `/v3/users/2973e7aee68e4f378590175d021450d7` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:00.410615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2973e7aee68e4f378590175d021450d7)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:00.429169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:00.467155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e15b41cc8cf47e49665fc053827db61'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:00.587493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 892/1758] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:58:59 2022] DELETE /identity/v3/users/3e15b41cc8cf47e49665fc053827db61 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:00.588441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:00.589880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:00.773391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaec02-c5c0-4e81-b396-372abca1a0e6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:00.789098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:00.789898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:00.790189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:00.790588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] PATH_INFO: `/v3/users/ffae499b43704e49ad470802505cb4b0` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:00.792014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffae499b43704e49ad470802505cb4b0)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:00.794148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:00.862510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2973e7aee68e4f378590175d021450d7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:00.882514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2973e7aee68e4f378590175d021450d7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.007760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2973e7aee68e4f378590175d021450d7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.008693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2973e7aee68e4f378590175d021450d7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.044785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6798e915-a159-4235-bad1-b6925e9f8adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2973e7aee68e4f378590175d021450d7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.064018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 867/1759] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:00 2022] DELETE /identity/v3/users/2973e7aee68e4f378590175d021450d7 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:01.072781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:01.073815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:01.075263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:01.109255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:01.131472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:01.135536 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffae499b43704e49ad470802505cb4b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.136807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffae499b43704e49ad470802505cb4b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.138841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffae499b43704e49ad470802505cb4b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.149763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffae499b43704e49ad470802505cb4b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.151652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:01.172861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6414997a-42c0-485e-a49b-92dfa68d1e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffae499b43704e49ad470802505cb4b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.278959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 868/1760] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:01.280981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:01.284646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:01.309830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 893/1761] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:00 2022] DELETE /identity/v3/users/ffae499b43704e49ad470802505cb4b0 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:01.310897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028970e-85f0-4336-a533-015426f762cc None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:01.311167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028970e-85f0-4336-a533-015426f762cc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:01.311459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028970e-85f0-4336-a533-015426f762cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:01.316179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb842d72-a586-445a-b15e-dc8e49502394 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:01.376429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9028970e-85f0-4336-a533-015426f762cc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:01.382405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9028970e-85f0-4336-a533-015426f762cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:01.405670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:01.504102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:01.506441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:01.518082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:01.519927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] PATH_INFO: `/v3/users/04ca26e246f741eebe494ab62139e79f` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:01.525006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ca26e246f741eebe494ab62139e79f)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:01.539232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:01.580380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 894/1762] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:01.581825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028970e-85f0-4336-a533-015426f762cc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:01.607272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9028970e-85f0-4336-a533-015426f762cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:01.767416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028970e-85f0-4336-a533-015426f762cc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:01.776508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407b98e-6998-4ca4-9157-c429b1d48598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:01.777271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b98e-6998-4ca4-9157-c429b1d48598 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:01.777798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b98e-6998-4ca4-9157-c429b1d48598 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:01.779487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b98e-6998-4ca4-9157-c429b1d48598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:01.805612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b98e-6998-4ca4-9157-c429b1d48598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:01.807385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b98e-6998-4ca4-9157-c429b1d48598 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:01.812487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ca26e246f741eebe494ab62139e79f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.825131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ca26e246f741eebe494ab62139e79f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.831644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 895/1763] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:01.833179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:01.833508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:01.848830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:01.870282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:01.871669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:01.884060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 896/1764] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:01.885282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:01.886839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:01.891689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ca26e246f741eebe494ab62139e79f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.892573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ca26e246f741eebe494ab62139e79f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.917653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad3c60-9dcd-4a1b-8aab-d88a85cd6739 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:01.921169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ac0123fd-8484-4aeb-8f3e-4747b079945f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ca26e246f741eebe494ab62139e79f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:01.933886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:01.935375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:01.936267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:01.936707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:01.937141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:01.941843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 869/1765] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:01 2022] DELETE /identity/v3/users/04ca26e246f741eebe494ab62139e79f => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:01.943618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da729-2d97-4135-861e-fddda07aeb28 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:01.943994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da729-2d97-4135-861e-fddda07aeb28 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:01.944429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da729-2d97-4135-861e-fddda07aeb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:01.944928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:01.966568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:01.970067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:01.985116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 897/1766] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:01.991753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-721da729-2d97-4135-861e-fddda07aeb28 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:01.993111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-721da729-2d97-4135-861e-fddda07aeb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:02.054894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:02.057405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:02.084400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4e0a8-b1d4-4557-b1b1-3cb2aad987cf service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:02.143148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 870/1767] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:02.179789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87525d-575c-460c-8d71-774e0a6d07de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:02.180926 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87525d-575c-460c-8d71-774e0a6d07de service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:02.181421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87525d-575c-460c-8d71-774e0a6d07de service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:02.181740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87525d-575c-460c-8d71-774e0a6d07de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:02.184805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7f87525d-575c-460c-8d71-774e0a6d07de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:02.199000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87525d-575c-460c-8d71-774e0a6d07de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:02.200824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87525d-575c-460c-8d71-774e0a6d07de service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:02.216293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 898/1768] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:02.225720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:02.239939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721da729-2d97-4135-861e-fddda07aeb28 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:02.252688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721da729-2d97-4135-861e-fddda07aeb28 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:02.285358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d54b8-c2ea-4a37-bbb0-8f230e3514f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:02.288450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d54b8-c2ea-4a37-bbb0-8f230e3514f9 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:02.288450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d54b8-c2ea-4a37-bbb0-8f230e3514f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:02.288450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d54b8-c2ea-4a37-bbb0-8f230e3514f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:02.325662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d54b8-c2ea-4a37-bbb0-8f230e3514f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:02.328610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d54b8-c2ea-4a37-bbb0-8f230e3514f9 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:02.361285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 871/1769] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:03.575291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2628e-0ebc-4eff-b283-0b8ad0b19563 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:03.577504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2628e-0ebc-4eff-b283-0b8ad0b19563 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:03.578173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2628e-0ebc-4eff-b283-0b8ad0b19563 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:03.579814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 899/1770] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:59:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:59:03.629103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:03.633222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:03.633222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:03.682599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:03.684085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:03.765184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:03.851763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 872/1771] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:04.238096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2628e-0ebc-4eff-b283-0b8ad0b19563 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:04.240002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-63b2628e-0ebc-4eff-b283-0b8ad0b19563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:04.268179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:04.273794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2628e-0ebc-4eff-b283-0b8ad0b19563 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:04.273953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:04.301057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:04.304828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:04.304828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:04.304828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] PATH_INFO: `/v3/projects/68f47873153646c48edd017be882b933` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:04.304828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f47873153646c48edd017be882b933)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:04.306040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:04.312428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50335b-c154-49fd-894c-e573cd9eb48c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:04.339683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:04.340545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:04.340902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:04.342277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] PATH_INFO: `/v3/projects/ee3d3e0532c841cba91360873f962381` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:04.343932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3d3e0532c841cba91360873f962381)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:04.346379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:04.516556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f47873153646c48edd017be882b933', 'request_id': 'req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:04.542159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f47873153646c48edd017be882b933', 'request_id': 'req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:04.543269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3d3e0532c841cba91360873f962381', 'request_id': 'req-ae24d7bb-f993-4759-b244-3f885153841b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:04.555886 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3d3e0532c841cba91360873f962381', 'request_id': 'req-ae24d7bb-f993-4759-b244-3f885153841b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.047851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f47873153646c48edd017be882b933', 'request_id': 'req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.068945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] The token cache is being invalidate because project 68f47873153646c48edd017be882b933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:05.077537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.082503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.082503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 900/1772] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:04 2022] DELETE /identity/v3/projects/68f47873153646c48edd017be882b933 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:05.088414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:05.090198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:05.150746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3d3e0532c841cba91360873f962381', 'request_id': 'req-ae24d7bb-f993-4759-b244-3f885153841b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.193588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] The token cache is being invalidate because project ee3d3e0532c841cba91360873f962381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:05.193872 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.196828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.200476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 873/1773] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:04 2022] DELETE /identity/v3/projects/ee3d3e0532c841cba91360873f962381 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:05.204165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:05.206797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:05.258977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceeb8b-a649-4e2a-86e6-150ba09c1c60 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:05.265009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:05.357402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:05.357402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:05.357402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:05.357402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] PATH_INFO: `/v3/projects/bfdd32f053f74c4a946029934b7b6b0e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:05.358086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdd32f053f74c4a946029934b7b6b0e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:05.358086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:05.444894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24d7bb-f993-4759-b244-3f885153841b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:05.453300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b6a8b-e56d-4349-8cff-e078cea87407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:05.454968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b6a8b-e56d-4349-8cff-e078cea87407 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:05.455261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b6a8b-e56d-4349-8cff-e078cea87407 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:05.455556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b6a8b-e56d-4349-8cff-e078cea87407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:05.462828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-750b6a8b-e56d-4349-8cff-e078cea87407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:05.494663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b6a8b-e56d-4349-8cff-e078cea87407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:05.496816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b6a8b-e56d-4349-8cff-e078cea87407 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:05.513347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 874/1774] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:05.515097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5d866-540b-4f61-8511-f60d48971467 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:05.515397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5d866-540b-4f61-8511-f60d48971467 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:05.515691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5d866-540b-4f61-8511-f60d48971467 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:05.517712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 875/1775] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:59:05.521213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:05.521213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:05.521213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:05.555914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdd32f053f74c4a946029934b7b6b0e', 'request_id': 'req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.567795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdd32f053f74c4a946029934b7b6b0e', 'request_id': 'req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.575461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:05.578456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:05.637110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:05.648283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdd32f053f74c4a946029934b7b6b0e', 'request_id': 'req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.669483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] The token cache is being invalidate because project bfdd32f053f74c4a946029934b7b6b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:05.669804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.679003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:05.681465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 901/1776] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:05 2022] DELETE /identity/v3/projects/bfdd32f053f74c4a946029934b7b6b0e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:05.685309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:05.692060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:05.774917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 876/1777] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:05.776093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:05.778848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:05.837847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497799e-2cae-4d5d-8d94-8aa51e82b343 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:05.850383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:05.852387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:05.858870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:05.859846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] PATH_INFO: `/v3/projects/0a318aba020547b3b7a5eb8f4c2a9f26` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:05.863131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a318aba020547b3b7a5eb8f4c2a9f26)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:05.868491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:05.902423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde2ab-c74f-4f9b-b437-edd0ec5819cd admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:05.911901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:05.912381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:05.912671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:05.912954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] PATH_INFO: `/v3/users/854e6504e75b49eea60681eaf8083698` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:05.919195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854e6504e75b49eea60681eaf8083698)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:05.921201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:06.064618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a318aba020547b3b7a5eb8f4c2a9f26', 'request_id': 'req-feae918d-88a8-4728-8b2a-fa852bd29ce4'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.073341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a318aba020547b3b7a5eb8f4c2a9f26', 'request_id': 'req-feae918d-88a8-4728-8b2a-fa852bd29ce4'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.227263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a318aba020547b3b7a5eb8f4c2a9f26', 'request_id': 'req-feae918d-88a8-4728-8b2a-fa852bd29ce4'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.249356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] The token cache is being invalidate because project 0a318aba020547b3b7a5eb8f4c2a9f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:06.249817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.250551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.252130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 877/1778] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:05 2022] DELETE /identity/v3/projects/0a318aba020547b3b7a5eb8f4c2a9f26 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:06.257909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:06.268056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:06.271077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854e6504e75b49eea60681eaf8083698'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.283623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854e6504e75b49eea60681eaf8083698'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.283623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854e6504e75b49eea60681eaf8083698'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.291364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854e6504e75b49eea60681eaf8083698'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.327795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5d82521d-7890-41eb-8dde-4ffe02d391e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854e6504e75b49eea60681eaf8083698'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:06.421991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 902/1779] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:05 2022] DELETE /identity/v3/users/854e6504e75b49eea60681eaf8083698 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:06.423490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ebb7c-9e19-4ff9-99f9-0ac3455c3df4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:06.423881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ebb7c-9e19-4ff9-99f9-0ac3455c3df4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:06.424261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ebb7c-9e19-4ff9-99f9-0ac3455c3df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:06.437076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae918d-88a8-4728-8b2a-fa852bd29ce4 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:06.484092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d08ebb7c-9e19-4ff9-99f9-0ac3455c3df4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:06.489189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d08ebb7c-9e19-4ff9-99f9-0ac3455c3df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:06.663342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:06.666540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:06.666860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:06.667145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] PATH_INFO: `/v3/users/f49c390aa7094870a7d578b7292bf70c` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:06.671308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 903/1780] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:06.673191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:06.673344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49c390aa7094870a7d578b7292bf70c)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:06.673585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:06.678617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:06.682948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:06.722997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:06.724464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:06.859009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 904/1781] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:06.859906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:06.861227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:06.889292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e6a0-c0ff-41f0-a2ba-31983aa9b5b8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:06.895249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:06.895870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:06.896153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:06.896452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] PATH_INFO: `/v3/users/7a6455f9464a4140acc343b438696577` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:06.897697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6455f9464a4140acc343b438696577)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:06.899939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:07.319923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49c390aa7094870a7d578b7292bf70c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.335895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49c390aa7094870a7d578b7292bf70c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.349272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6455f9464a4140acc343b438696577'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.350213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6455f9464a4140acc343b438696577'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.351179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6455f9464a4140acc343b438696577'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.387604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6455f9464a4140acc343b438696577'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.403277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6455f9464a4140acc343b438696577'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.466842 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49c390aa7094870a7d578b7292bf70c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.468035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49c390aa7094870a7d578b7292bf70c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.497435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49c390aa7094870a7d578b7292bf70c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:07.510718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 878/1782] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:06 2022] DELETE /identity/v3/users/f49c390aa7094870a7d578b7292bf70c => generated 0 bytes in 1254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:07.512341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:07.521265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:07.565678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 905/1783] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:06 2022] DELETE /identity/v3/users/7a6455f9464a4140acc343b438696577 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:07.568737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:07.574601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:07.622664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa82d-ed3b-40ac-9278-1ba6a3b9c726 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:07.725905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:07.726955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:07.727816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:07.728501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:07.729333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:07.729975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:07.734150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:07.755894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 879/1784] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:07.760856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:07.784820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f3cf-5df4-4dc8-b9cd-cf92f55bd0e2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:07.792338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:07.797639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:07.798861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48ec17-f580-41a2-b98b-e00f2f81df17 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:07.799171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:07.800466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:07.801651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:07.806165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:07.813323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:07.816384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:07.816384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:07.818664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:07.821094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:07.865351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:07.867029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:07.880003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 906/1785] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:07.947444 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 880/1786] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:07 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:07.948340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:07.965483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb992c-9bf6-4c40-ac1f-268ac9a38042 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:08.121487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:08.122315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:08.122914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:08.123534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:08.124483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:08.127129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:08.482968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 907/1787] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:07 2022] POST /identity/v3/users => generated 287 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:08.488345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:08.502461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:08.509742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b396a0-5f82-48f7-aa83-55ce2c200d28 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:08.516558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:08.517174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:08.517580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:08.517913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:08.518765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:08.520467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:08.540007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 881/1788] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:08.541071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:08.568120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:08.579836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:08.579994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9f51-74b4-494f-b79b-15731fb156ac admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:08.596465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:08.600015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:08.600848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:08.602205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:08.603937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:08.607684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:08.617966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56820ea4-fcb9-4b02-992f-b3aed15bef8f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:08.627277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 908/1789] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:08.628392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:08.644958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:08.645198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9c58-3f48-4006-8076-06248b42d7d6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:08.646498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:08.646902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:08.647405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] PATH_INFO: `/v3/projects/fd1156fbe6a84c1eacbfae6e5c95a903` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:08.650862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1156fbe6a84c1eacbfae6e5c95a903)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:08.653719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:08.659736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a2f78-267c-4c77-a378-23d6dc335d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:08.660495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2f78-267c-4c77-a378-23d6dc335d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:08.660783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2f78-267c-4c77-a378-23d6dc335d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:08.661071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2f78-267c-4c77-a378-23d6dc335d3f admin admin] PATH_INFO: `/v3/projects/6d9096d239c748e1b24078a2b45527ee/users/8087cdf690014a7b9e7bafcd8c8d7efe/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:08.694416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a2f78-267c-4c77-a378-23d6dc335d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9096d239c748e1b24078a2b45527ee, user_id=8087cdf690014a7b9e7bafcd8c8d7efe, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:08.698675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a2f78-267c-4c77-a378-23d6dc335d3f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:08.828788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 909/1790] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:08 2022] PUT /identity/v3/projects/6d9096d239c748e1b24078a2b45527ee/users/8087cdf690014a7b9e7bafcd8c8d7efe/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:08.834701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9c90-722a-4831-b1d9-8bcfd2dee40d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:08.834970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9c90-722a-4831-b1d9-8bcfd2dee40d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:08.835257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9c90-722a-4831-b1d9-8bcfd2dee40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:08.849395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1156fbe6a84c1eacbfae6e5c95a903', 'request_id': 'req-636cad4c-74f1-40ba-a532-223b81985dae'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:08.879847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-777b9c90-722a-4831-b1d9-8bcfd2dee40d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:08.882113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1156fbe6a84c1eacbfae6e5c95a903', 'request_id': 'req-636cad4c-74f1-40ba-a532-223b81985dae'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:08.882484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-777b9c90-722a-4831-b1d9-8bcfd2dee40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:08.955184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:08.988243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1156fbe6a84c1eacbfae6e5c95a903', 'request_id': 'req-636cad4c-74f1-40ba-a532-223b81985dae'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:08.994628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 910/1791] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:09.014941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] The token cache is being invalidate because project fd1156fbe6a84c1eacbfae6e5c95a903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:09.017192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:09.045820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:09.047847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 882/1792] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:08 2022] DELETE /identity/v3/projects/fd1156fbe6a84c1eacbfae6e5c95a903 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:09.053098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa424-fee5-47eb-ad7f-639424474f30 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.055577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa424-fee5-47eb-ad7f-639424474f30 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.055577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa424-fee5-47eb-ad7f-639424474f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.087439 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:09.089178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:09.109025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a6afa424-fee5-47eb-ad7f-639424474f30 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:09.110759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a6afa424-fee5-47eb-ad7f-639424474f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:09.167662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 911/1793] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:09.171734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880243-b658-405a-a464-d1db9024d08f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.172029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880243-b658-405a-a464-d1db9024d08f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.172313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880243-b658-405a-a464-d1db9024d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.216622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cad4c-74f1-40ba-a532-223b81985dae admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:09.220889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:09.221721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.224142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.224142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.224947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:09.243118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-df880243-b658-405a-a464-d1db9024d08f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:09.252209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-df880243-b658-405a-a464-d1db9024d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:09.254073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:09.260815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:09.272574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 912/1794] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:09.277288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880243-b658-405a-a464-d1db9024d08f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:09.286383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 883/1795] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:09.306408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880243-b658-405a-a464-d1db9024d08f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:09.314195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:09.315138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.317196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.317498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.318708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:09.319314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:09.321161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:09.339272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 913/1796] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:09.343514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:09.357335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78dc8d-a29f-418f-a097-bcda0682d781 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:09.364944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b70be-2773-4b93-beba-975224de732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:09.365797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b70be-2773-4b93-beba-975224de732b admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.366254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b70be-2773-4b93-beba-975224de732b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.366540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b70be-2773-4b93-beba-975224de732b admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.372875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b70be-2773-4b93-beba-975224de732b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:09.375614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b70be-2773-4b93-beba-975224de732b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:09.520113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 884/1797] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:09 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:09.521039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:09.531774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0589d-bb41-484f-88d4-6cc25d391963 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:09.630200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:09.630971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.631362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.631746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.632833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:09.637993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:09.715094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b70be-2773-4b93-beba-975224de732b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:09.719066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-668b70be-2773-4b93-beba-975224de732b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:09.730001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b70be-2773-4b93-beba-975224de732b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:09.734789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:09.735455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.735787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.736324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] PATH_INFO: `/v3/projects/5b7f69096cf34c9fb8c028237ef5c48e` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.737741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7f69096cf34c9fb8c028237ef5c48e)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:09.740458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:09.753798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 914/1798] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:09 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:09.755608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:09.770794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3103943-4ba6-4afe-9325-c6eb451a4a53 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:09.777700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:09.777940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.778235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.778512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.779222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:09.780868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:09.801373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 915/1799] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:09.802413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:09.804375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:09.829809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013773c-e73b-42a6-8315-4e6d3f1c7b6d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:09.854643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:09.855366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:09.855659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:09.856937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] PATH_INFO: `/v3/projects/6a834872b19a488d98bf2a5dc6a8e043` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:09.857787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a834872b19a488d98bf2a5dc6a8e043)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:09.859726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:09.899186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7f69096cf34c9fb8c028237ef5c48e', 'request_id': 'req-fa6ce633-ef95-4cac-bead-ef38815eed80'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:09.905742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7f69096cf34c9fb8c028237ef5c48e', 'request_id': 'req-fa6ce633-ef95-4cac-bead-ef38815eed80'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:09.994896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a834872b19a488d98bf2a5dc6a8e043', 'request_id': 'req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.001852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a834872b19a488d98bf2a5dc6a8e043', 'request_id': 'req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.013573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7f69096cf34c9fb8c028237ef5c48e', 'request_id': 'req-fa6ce633-ef95-4cac-bead-ef38815eed80'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.031756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] The token cache is being invalidate because project 5b7f69096cf34c9fb8c028237ef5c48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:10.032523 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.033328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.035466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 885/1800] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:09 2022] DELETE /identity/v3/projects/5b7f69096cf34c9fb8c028237ef5c48e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:10.036594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.038488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:10.101675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a834872b19a488d98bf2a5dc6a8e043', 'request_id': 'req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.116275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] The token cache is being invalidate because project 6a834872b19a488d98bf2a5dc6a8e043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:10.116571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.118350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-50d54ddb-f9bc-4c63-b95e-cd1d02123db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:10.121846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 916/1801] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:09 2022] DELETE /identity/v3/projects/6a834872b19a488d98bf2a5dc6a8e043 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:10.123303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0ccdc-126b-4743-93a8-7273198a3c94 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.130307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0ccdc-126b-4743-93a8-7273198a3c94 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.130307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0ccdc-126b-4743-93a8-7273198a3c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.147757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2bc0ccdc-126b-4743-93a8-7273198a3c94 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:10.149003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2bc0ccdc-126b-4743-93a8-7273198a3c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:10.158920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ce633-ef95-4cac-bead-ef38815eed80 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.215935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 917/1802] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:10.217239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.217566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.217848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.226799 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9c197-fbf9-409a-af1b-6a3f2ea175b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.227499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c197-fbf9-409a-af1b-6a3f2ea175b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.227790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c197-fbf9-409a-af1b-6a3f2ea175b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.228074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c197-fbf9-409a-af1b-6a3f2ea175b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.228785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9c197-fbf9-409a-af1b-6a3f2ea175b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.230584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9c197-fbf9-409a-af1b-6a3f2ea175b5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.241034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:10.242403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:10.249903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 886/1803] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:10.249903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c1dca-0c0a-4620-97b9-43ce80857b2e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.249903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c1dca-0c0a-4620-97b9-43ce80857b2e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.249903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c1dca-0c0a-4620-97b9-43ce80857b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.260846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 918/1804] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:10.260846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.260846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:10.270047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bf6dd-80d8-4805-91cf-e94354988fe4 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.278324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-9a5c1dca-0c0a-4620-97b9-43ce80857b2e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:10.279742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9a5c1dca-0c0a-4620-97b9-43ce80857b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:10.280957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.282152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.282780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.283314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] PATH_INFO: `/v3/projects/21cb032d6bff4429b695252122a0f02e/users/46bae01a32854ce0806e1721e34fc5fb/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.294752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 887/1805] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:10.299173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc635a-a0c5-4f71-b42b-f63f428266cc None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.300126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc635a-a0c5-4f71-b42b-f63f428266cc None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.300964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc635a-a0c5-4f71-b42b-f63f428266cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.306923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cb032d6bff4429b695252122a0f02e, user_id=46bae01a32854ce0806e1721e34fc5fb, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.310139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.328018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dfbc635a-a0c5-4f71-b42b-f63f428266cc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:10.328813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dfbc635a-a0c5-4f71-b42b-f63f428266cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:10.338238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 888/1806] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:10.339176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc635a-a0c5-4f71-b42b-f63f428266cc None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.350482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc635a-a0c5-4f71-b42b-f63f428266cc None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.358103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.358103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.358103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.358103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.358430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:10.358430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.359448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.373373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 889/1807] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:10.374554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.387273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f78aa-f7d9-45f7-9098-0c975c3852fe admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.392085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fae1f-b6a7-4cc5-addd-e138315ed7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.392730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fae1f-b6a7-4cc5-addd-e138315ed7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.393014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fae1f-b6a7-4cc5-addd-e138315ed7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.393294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fae1f-b6a7-4cc5-addd-e138315ed7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.394077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fae1f-b6a7-4cc5-addd-e138315ed7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:10.394386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fae1f-b6a7-4cc5-addd-e138315ed7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.396075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fae1f-b6a7-4cc5-addd-e138315ed7d6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.412395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 919/1808] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:10 2022] PUT /identity/v3/projects/21cb032d6bff4429b695252122a0f02e/users/46bae01a32854ce0806e1721e34fc5fb/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:10.413893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.425608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 890/1809] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:10.427788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19366-86ab-4273-9bff-cd745b0493ca None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.428246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19366-86ab-4273-9bff-cd745b0493ca None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.428724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19366-86ab-4273-9bff-cd745b0493ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.463010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2ed19366-86ab-4273-9bff-cd745b0493ca None None] MFA Rules not processed for user `46bae01a32854ce0806e1721e34fc5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:10.464270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2ed19366-86ab-4273-9bff-cd745b0493ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:10.512020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467196aa-a0ea-4434-820c-425c9582a520 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.518695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.519238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.519529 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.519810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.520505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.522747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.586820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 891/1810] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:10.588558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed19366-86ab-4273-9bff-cd745b0493ca None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.601664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed19366-86ab-4273-9bff-cd745b0493ca None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.606758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.607994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.607994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.607994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.608681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.611052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.675112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 920/1811] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/projects => generated 405 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:10.676226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.749493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e055ef9-e304-49e8-8a19-e4609e9499bd admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.754847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.755853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.756347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.756805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.757870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.760141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.774198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 892/1812] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:10.775029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.850899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5459-a8b5-4f14-ac35-9af59031d20d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.855793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.856426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.856698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.856973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.857682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.859735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:10.914139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 921/1813] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/projects => generated 375 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:10.916421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:10.982390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a052-6e46-4f9f-9f09-0310445bba90 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:10.986928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:10.988123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:10.988406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:10.988678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:10.989343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:10.991306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.020632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 893/1814] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/users => generated 303 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:11.020632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.031883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9f4a6-95d5-47dd-90ad-83d5bd6ff062 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.037224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.037725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.038047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.038283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.038953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.041090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.110256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 922/1815] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:10 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:11.110256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.125203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b295a-ed7d-4392-a553-421483c31c9d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.131962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.132777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.133062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.133344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.134085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.135738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.146964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 923/1816] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:11.148256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.159223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b3351-59d9-40ea-adab-eca9ccba8636 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.162905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 894/1817] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:11 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:11.162905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.166580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.167279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.167639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.167988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.168752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.170592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.180713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e76923-0f03-4a61-b585-311ebd39f618 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.189061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.191453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.191940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.192452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.193589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.197708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.198311 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 924/1818] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:11.199289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.215147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e124d-f52f-4b2b-a65f-50caced26d57 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.226962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 895/1819] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:11.227231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.227231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.227231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.227710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.227859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.227859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.227859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.242138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ed7b-b67c-4085-8597-b1674809c86b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.247451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 925/1820] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:11.249226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.254682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.255381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.255996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.257175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.258388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.261664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1345cd-d3b8-48e2-9130-07f5872e108b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.264592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.269290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.270332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.271357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.271875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] PATH_INFO: `/v3/projects/c26cffa1f95f46a2b09c02a6f5f6bed8/users/db59a0a5ec0a46ca988851fdb9f2e49c/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.296968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 896/1821] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:11.298042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.307057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26cffa1f95f46a2b09c02a6f5f6bed8, user_id=db59a0a5ec0a46ca988851fdb9f2e49c, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.312179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.316908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efdff5-712f-4b96-a45f-ec018e3baa46 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.324273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427fc50-edd0-4e04-a467-8a43b3f97f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.324969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427fc50-edd0-4e04-a467-8a43b3f97f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.325252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427fc50-edd0-4e04-a467-8a43b3f97f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.325546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427fc50-edd0-4e04-a467-8a43b3f97f7d admin admin] PATH_INFO: `/v3/projects/a6fba1017c214b7da79ca17449a910e4/users/d8c361a7eb3645e7b09a5b459743ad28/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.351282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427fc50-edd0-4e04-a467-8a43b3f97f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fba1017c214b7da79ca17449a910e4, user_id=d8c361a7eb3645e7b09a5b459743ad28, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.354178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427fc50-edd0-4e04-a467-8a43b3f97f7d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.390852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:11.480521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 926/1822] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:11 2022] PUT /identity/v3/projects/c26cffa1f95f46a2b09c02a6f5f6bed8/users/db59a0a5ec0a46ca988851fdb9f2e49c/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:11.481401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.493419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 897/1823] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:11 2022] PUT /identity/v3/projects/a6fba1017c214b7da79ca17449a910e4/users/d8c361a7eb3645e7b09a5b459743ad28/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:11.494752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c845-1469-442c-be47-ea917b620412 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.495048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c845-1469-442c-be47-ea917b620412 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.495348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c845-1469-442c-be47-ea917b620412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.530056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-3815c845-1469-442c-be47-ea917b620412 None None] MFA Rules not processed for user `8087cdf690014a7b9e7bafcd8c8d7efe`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:11.532224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3815c845-1469-442c-be47-ea917b620412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:11.549246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ab22-1363-4312-8eac-2fce8fd95e8f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.608385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.609162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.609452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.609765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] PATH_INFO: `/v3/projects/c71fdcd829bd4c99ac00339a4ccf3511/users/6d6d71eac88245cab9f969b43ede2863/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.622482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 898/1824] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:11.623844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed79ce2-4f78-4145-bff4-85b8943ef352 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.624143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed79ce2-4f78-4145-bff4-85b8943ef352 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.624426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed79ce2-4f78-4145-bff4-85b8943ef352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.637352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71fdcd829bd4c99ac00339a4ccf3511, user_id=6d6d71eac88245cab9f969b43ede2863, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.637352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.645315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1ed79ce2-4f78-4145-bff4-85b8943ef352 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:11.646609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1ed79ce2-4f78-4145-bff4-85b8943ef352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:11.654230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 899/1825] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:11.655009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed79ce2-4f78-4145-bff4-85b8943ef352 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.664572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed79ce2-4f78-4145-bff4-85b8943ef352 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.669187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.669841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.670127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.670403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.671141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.673126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.684443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 900/1826] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:11.685276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.686933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:11.746382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280eb81-feb5-4fd7-a666-53b421e8f870 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.758166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.758166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.758166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.758166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.764640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.766155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.775492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 901/1827] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:11.776316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.777661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:11.794991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 927/1828] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:11 2022] PUT /identity/v3/projects/c71fdcd829bd4c99ac00339a4ccf3511/users/6d6d71eac88245cab9f969b43ede2863/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:11.798002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:11.859856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06d5d1-41a7-47a4-9081-869de36ea3b9 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.904356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305f36-20ed-445c-8744-d938d1aa46b6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:11.910413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c3c5-ca7e-45cd-811d-02f47b7bd85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.911306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c3c5-ca7e-45cd-811d-02f47b7bd85d admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.911602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c3c5-ca7e-45cd-811d-02f47b7bd85d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.912056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c3c5-ca7e-45cd-811d-02f47b7bd85d admin admin] PATH_INFO: `/v3/projects/a6fba1017c214b7da79ca17449a910e4/users/d8c361a7eb3645e7b09a5b459743ad28/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.915254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c3c5-ca7e-45cd-811d-02f47b7bd85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fba1017c214b7da79ca17449a910e4, user_id=d8c361a7eb3645e7b09a5b459743ad28, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.918845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:11.921368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c3c5-ca7e-45cd-811d-02f47b7bd85d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.923405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997804-8150-46b2-babb-300620f9b745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:11.924548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997804-8150-46b2-babb-300620f9b745 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.936284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997804-8150-46b2-babb-300620f9b745 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.936284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997804-8150-46b2-babb-300620f9b745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.947097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 928/1829] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:11 2022] PUT /identity/v3/projects/a6fba1017c214b7da79ca17449a910e4/users/d8c361a7eb3645e7b09a5b459743ad28/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:11.947097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3012a-c545-4471-a248-476e14df32e2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.947097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3012a-c545-4471-a248-476e14df32e2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.947097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3012a-c545-4471-a248-476e14df32e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.951860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997804-8150-46b2-babb-300620f9b745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:11.953702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997804-8150-46b2-babb-300620f9b745 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:11.966376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 902/1830] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:11.967643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:11.967932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:11.968216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:11.969351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c3d3012a-c545-4471-a248-476e14df32e2 None None] MFA Rules not processed for user `6d6d71eac88245cab9f969b43ede2863`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:11.970718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c3d3012a-c545-4471-a248-476e14df32e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:11.997813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] MFA Rules not processed for user `d8c361a7eb3645e7b09a5b459743ad28`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:11.999108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:12.038060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 929/1831] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:12.043112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3012a-c545-4471-a248-476e14df32e2 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:12.067186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 903/1832] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:12.083308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:12.085881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:12.115670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3012a-c545-4471-a248-476e14df32e2 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:12.120454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:12.121079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.121361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.121715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.123489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:12.125078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:12.157539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538905-4c2a-4759-8e57-62693672f6cb None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:12.166983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:12.167835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.168213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.168899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.238310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:12.239767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:12.249598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 904/1833] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:12.270012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 930/1834] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:12 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:12.270116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:12.290377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b0e8-7fb8-4fdf-9337-55fb0266eb2f service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:12.384650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:12.386302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.386626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.386910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.387591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:12.389769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:12.555830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 905/1835] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:12 2022] POST /identity/v3/users => generated 291 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:12.560254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:12.571155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610141d0-3c93-4734-b6ce-778f88f13d3a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:12.576152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:12.581789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.581789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.581789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.581789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:12.581789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:12.593654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 931/1836] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:12.595584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:12.606480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f710ee-973f-4a8c-b398-a751e7c914d2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:12.611746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:12.612930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.613219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.613640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] PATH_INFO: `/v3/projects/07bf79152f8a46d7b9ac4cd585052ba4/users/9313684f0162453ea00fbee3701ea646/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.633136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bf79152f8a46d7b9ac4cd585052ba4, user_id=9313684f0162453ea00fbee3701ea646, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:12.636027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:12.722238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 906/1837] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:12 2022] PUT /identity/v3/projects/07bf79152f8a46d7b9ac4cd585052ba4/users/9313684f0162453ea00fbee3701ea646/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:12.724913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:12.735374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9115a9e-81a1-4a3b-8b10-2794e1b7c617 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:12.798340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d9e3f-0a67-4849-a41c-0281a39b3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:12.799022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9e3f-0a67-4849-a41c-0281a39b3839 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.799450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9e3f-0a67-4849-a41c-0281a39b3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.800305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9e3f-0a67-4849-a41c-0281a39b3839 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.800977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d9e3f-0a67-4849-a41c-0281a39b3839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:12.802791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d9e3f-0a67-4849-a41c-0281a39b3839 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:12.825327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 932/1838] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:12.825481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:12.844214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4649-bc1c-4acb-bb9d-131f276a7cc9 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:12.853376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:12.854127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.854410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.854698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] PATH_INFO: `/v3/projects/07bf79152f8a46d7b9ac4cd585052ba4/users/9313684f0162453ea00fbee3701ea646/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.861738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bf79152f8a46d7b9ac4cd585052ba4, user_id=9313684f0162453ea00fbee3701ea646, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:12.865156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:12.892778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 907/1839] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:12 2022] PUT /identity/v3/projects/07bf79152f8a46d7b9ac4cd585052ba4/users/9313684f0162453ea00fbee3701ea646/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:12.895915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e08d-851f-409f-b8ca-88d7d121db1f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:12.896429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e08d-851f-409f-b8ca-88d7d121db1f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:12.896711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e08d-851f-409f-b8ca-88d7d121db1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:12.948023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ee13e08d-851f-409f-b8ca-88d7d121db1f None None] MFA Rules not processed for user `9313684f0162453ea00fbee3701ea646`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:12.950170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ee13e08d-851f-409f-b8ca-88d7d121db1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:13.051142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 933/1840] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:13.062904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:13.122566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29d1e-70f4-493a-b12d-a263f613ce51 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:13.126575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0ee76-e01e-48fd-9044-a0798358affc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:13.127226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ee76-e01e-48fd-9044-a0798358affc service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:13.127509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ee76-e01e-48fd-9044-a0798358affc service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:13.127897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ee76-e01e-48fd-9044-a0798358affc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:13.138706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0ee76-e01e-48fd-9044-a0798358affc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:13.140408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0ee76-e01e-48fd-9044-a0798358affc service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:13.157718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 908/1841] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:13.742744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46432-c80a-43fb-81da-c0f6abe689bd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:13.743659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46432-c80a-43fb-81da-c0f6abe689bd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:13.744155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46432-c80a-43fb-81da-c0f6abe689bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:13.778436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-44b46432-c80a-43fb-81da-c0f6abe689bd None None] MFA Rules not processed for user `db59a0a5ec0a46ca988851fdb9f2e49c`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:13.780043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-44b46432-c80a-43fb-81da-c0f6abe689bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:13.811853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1aab-d09b-48c9-8042-6241674cd954 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:13.815860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1aab-d09b-48c9-8042-6241674cd954 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:13.815860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1aab-d09b-48c9-8042-6241674cd954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:13.835016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f00b1aab-d09b-48c9-8042-6241674cd954 None None] MFA Rules not processed for user `8087cdf690014a7b9e7bafcd8c8d7efe`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:13.836563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f00b1aab-d09b-48c9-8042-6241674cd954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:13.862270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 934/1842] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:13.863336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46432-c80a-43fb-81da-c0f6abe689bd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:13.899320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 909/1843] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:13.941890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46432-c80a-43fb-81da-c0f6abe689bd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:13.947367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:13.947647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:13.947755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:13.948037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:13.948730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:13.950721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:14.079264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 935/1844] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:13 2022] POST /identity/v3/projects => generated 401 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:14.084592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1aab-d09b-48c9-8042-6241674cd954 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:14.099344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1aab-d09b-48c9-8042-6241674cd954 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:14.197069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:14.209581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:14.209581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:14.209581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:14.209581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:14.209581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:14.312660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 910/1845] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:14 2022] POST /identity/v3/users => generated 307 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:14.317058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:14.337767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eaf12-1933-4467-bfd7-8b3c667f6dda admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:14.343829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:14.344493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:14.345093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:14.345093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:14.347100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:14.347984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:14.376308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 936/1846] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:14.380085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:14.391044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c2d7-1cb1-450b-9874-51624fd13411 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:14.397880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:14.398811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:14.399165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:14.399533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] PATH_INFO: `/v3/projects/71be2d0b52c14f25a708f67ee7e23d96/users/98a84f22f13f48998d5b531e42e388a5/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:14.418825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71be2d0b52c14f25a708f67ee7e23d96, user_id=98a84f22f13f48998d5b531e42e388a5, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:14.421812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:14.570420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 911/1847] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:14 2022] PUT /identity/v3/projects/71be2d0b52c14f25a708f67ee7e23d96/users/98a84f22f13f48998d5b531e42e388a5/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:14.574442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:14.589944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b00ef5-1261-4c1a-8fd6-a0291070a452 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:14.651496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:14.652222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:14.652568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:14.652920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:14.653728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:14.655545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:14.678756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 937/1848] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:14.679909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:14.694389 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c123-da86-4982-b4c2-05fca450e999 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:14.699824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e784307-b62c-4e60-a25c-e06be2fd8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:14.700510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e784307-b62c-4e60-a25c-e06be2fd8d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:14.700794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e784307-b62c-4e60-a25c-e06be2fd8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:14.701073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e784307-b62c-4e60-a25c-e06be2fd8d82 admin admin] PATH_INFO: `/v3/projects/71be2d0b52c14f25a708f67ee7e23d96/users/98a84f22f13f48998d5b531e42e388a5/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:14.703086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e784307-b62c-4e60-a25c-e06be2fd8d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71be2d0b52c14f25a708f67ee7e23d96, user_id=98a84f22f13f48998d5b531e42e388a5, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:14.706484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e784307-b62c-4e60-a25c-e06be2fd8d82 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:14.722136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 912/1849] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:14 2022] PUT /identity/v3/projects/71be2d0b52c14f25a708f67ee7e23d96/users/98a84f22f13f48998d5b531e42e388a5/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:14.814312 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:15.429916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:15.954451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:16.066655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dee57-4f9b-4505-976a-ccb05cd434e6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:16.155989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:16.155989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:16.156259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:16.156590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:16.234279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:16.236907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:16.256433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 938/1850] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:16.721821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b18ad-aa82-4d7f-acee-ddc29665ce13 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:16.722298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b18ad-aa82-4d7f-acee-ddc29665ce13 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:16.722384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b18ad-aa82-4d7f-acee-ddc29665ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:16.771316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2e8b18ad-aa82-4d7f-acee-ddc29665ce13 None None] MFA Rules not processed for user `98a84f22f13f48998d5b531e42e388a5`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:16.773426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2e8b18ad-aa82-4d7f-acee-ddc29665ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:16.914171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 913/1851] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:17.319715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:17.437253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923750-9f8b-4270-a6b4-c53126740af0 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:17.445264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:17.446462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:17.446923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:17.447368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] PATH_INFO: `/v3/users/6d6d71eac88245cab9f969b43ede2863` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:17.450841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6d71eac88245cab9f969b43ede2863)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:17.454542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:17.785818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6d71eac88245cab9f969b43ede2863'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:17.786634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6d71eac88245cab9f969b43ede2863'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:17.787509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6d71eac88245cab9f969b43ede2863'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:17.797197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6d71eac88245cab9f969b43ede2863'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:17.809427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:17.809756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852e04-d9ef-4c21-8371-af0b0922d514 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:17.810254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852e04-d9ef-4c21-8371-af0b0922d514 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:17.810374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852e04-d9ef-4c21-8371-af0b0922d514 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:17.812240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 914/1852] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:59:17.826554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:17.827128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:17.827695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:17.840005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4e8082a4-a724-4611-87de-1960b5f4db17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6d71eac88245cab9f969b43ede2863'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:17.859052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:17.861479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:17.963101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 915/1853] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:59:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:17.974148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:17.976687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:17.998969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 939/1854] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:17 2022] DELETE /identity/v3/users/6d6d71eac88245cab9f969b43ede2863 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:18.004329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:18.011932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc27e-f366-406c-b287-c50d5f4b2a01 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:18.019123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:18.019554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:18.069861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:18.071293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:18.111908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:18.116322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:18.116322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:18.116322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:18.128901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:18.132314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:18.146310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 916/1855] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:18.153574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 940/1856] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:18.163341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:18.165257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:18.257960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be19fe-4d4b-4878-9f61-5125cebedeb7 service placement] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:18.266001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:18.268309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:18.268961 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:18.269973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:18.299205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:18.302193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:18.321554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 917/1857] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:18.656346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:18.906399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:18.907974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:18.924417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbcc1f-eb0a-43c1-bdcb-a8141069d4dc None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:18.930665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229a6f-1695-4905-97da-404384016692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:18.931482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229a6f-1695-4905-97da-404384016692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:18.931862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229a6f-1695-4905-97da-404384016692 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:18.932316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229a6f-1695-4905-97da-404384016692 admin admin] PATH_INFO: `/v3/projects/c71fdcd829bd4c99ac00339a4ccf3511` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:18.933981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26229a6f-1695-4905-97da-404384016692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71fdcd829bd4c99ac00339a4ccf3511)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:18.941332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26229a6f-1695-4905-97da-404384016692 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:19.072759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-26229a6f-1695-4905-97da-404384016692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71fdcd829bd4c99ac00339a4ccf3511', 'request_id': 'req-26229a6f-1695-4905-97da-404384016692'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:19.080000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-26229a6f-1695-4905-97da-404384016692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71fdcd829bd4c99ac00339a4ccf3511', 'request_id': 'req-26229a6f-1695-4905-97da-404384016692'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:19.173574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-26229a6f-1695-4905-97da-404384016692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71fdcd829bd4c99ac00339a4ccf3511', 'request_id': 'req-26229a6f-1695-4905-97da-404384016692'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:19.197201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-26229a6f-1695-4905-97da-404384016692 admin admin] The token cache is being invalidate because project c71fdcd829bd4c99ac00339a4ccf3511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:19.198106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-26229a6f-1695-4905-97da-404384016692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:19.202211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-26229a6f-1695-4905-97da-404384016692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:19.210427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 941/1858] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:18 2022] DELETE /identity/v3/projects/c71fdcd829bd4c99ac00339a4ccf3511 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:19.212519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:19.230916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673e223-9c58-4956-8a86-5b0d5df4a018 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:19.359545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:19.360801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:19.361266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:19.361764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] PATH_INFO: `/v3/users/9313684f0162453ea00fbee3701ea646` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:19.365625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9313684f0162453ea00fbee3701ea646)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:19.368955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:19.501189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240346-29e1-4267-9a03-6ec9052bba19 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:19.501712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240346-29e1-4267-9a03-6ec9052bba19 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:19.502178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240346-29e1-4267-9a03-6ec9052bba19 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:19.505751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 942/1859] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:59:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:59:19.542473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:19.543064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:19.543617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:19.578352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] MFA Rules not processed for user `7d1d3e9e0b7042978e47d3912df36daf`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:19.580643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:19.729987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 943/1860] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:19.750789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:19.753675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:19.809477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b80eac-9c8b-4271-8def-a81df0d3a169 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:19.819723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:19.821139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:19.821658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:19.822203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:19.828693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9313684f0162453ea00fbee3701ea646'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:19.844857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:19.854757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:19.858434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9313684f0162453ea00fbee3701ea646'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:19.893187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 944/1861] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:19.894476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:19.899769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:19.931276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa6c4-f9c9-4e23-bcd2-0684a6bda9a7 service placement] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:19.946712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:19.947106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:19.947894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:19.948234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] PATH_INFO: `/v3/users/db59a0a5ec0a46ca988851fdb9f2e49c` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:19.951586 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db59a0a5ec0a46ca988851fdb9f2e49c)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:19.956026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:20.005080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9313684f0162453ea00fbee3701ea646'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.008289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9313684f0162453ea00fbee3701ea646'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.028991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7f5d7eb7-00a9-4b54-b1b5-94309cfafa5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9313684f0162453ea00fbee3701ea646'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.046453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 918/1862] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:19 2022] DELETE /identity/v3/users/9313684f0162453ea00fbee3701ea646 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:20.059427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095bcb-5c28-4b35-88fd-0c1ff821608e None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:20.059666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095bcb-5c28-4b35-88fd-0c1ff821608e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:20.059921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095bcb-5c28-4b35-88fd-0c1ff821608e None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:20.061326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 919/1863] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 15:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 15:59:20.072426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:20.072784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:20.073321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:20.103937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:20.106000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:20.202682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 920/1864] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 15:59:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:20.218863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:20.220329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:20.245505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2822f-e9a9-4c2d-a3e8-fdcebc0d1ca6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:20.251280 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:20.251928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:20.252215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:20.252496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:20.264859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:20.266797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:20.285727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 921/1865] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:20.342015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db59a0a5ec0a46ca988851fdb9f2e49c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.343606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db59a0a5ec0a46ca988851fdb9f2e49c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.344896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db59a0a5ec0a46ca988851fdb9f2e49c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.361723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db59a0a5ec0a46ca988851fdb9f2e49c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.390866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db59a0a5ec0a46ca988851fdb9f2e49c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:20.577962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 945/1866] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:19 2022] DELETE /identity/v3/users/db59a0a5ec0a46ca988851fdb9f2e49c => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:21.009551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:21.011077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:21.109968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a716a4-3951-42dd-9a72-127e79a00f1d service nova] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:21.190009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:21.191515 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:21.191997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:21.193534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] PATH_INFO: `/v3/projects/c26cffa1f95f46a2b09c02a6f5f6bed8` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:21.196069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26cffa1f95f46a2b09c02a6f5f6bed8)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:21.198824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:21.275875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:21.311838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:21.313546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:21.327971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e33783-8dd2-4971-a3eb-6dc2afbd98a6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:21.333416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:21.334119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:21.334404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:21.334705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] PATH_INFO: `/v3/projects/07bf79152f8a46d7b9ac4cd585052ba4` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:21.336059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bf79152f8a46d7b9ac4cd585052ba4)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:21.338340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:21.365825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26cffa1f95f46a2b09c02a6f5f6bed8', 'request_id': 'req-53fe516e-63e2-4737-b1b7-325aac33a21c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:21.373332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26cffa1f95f46a2b09c02a6f5f6bed8', 'request_id': 'req-53fe516e-63e2-4737-b1b7-325aac33a21c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:21.509872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bf79152f8a46d7b9ac4cd585052ba4', 'request_id': 'req-ed84710f-7ce9-4a3f-ae94-c778bf439039'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:21.518774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bf79152f8a46d7b9ac4cd585052ba4', 'request_id': 'req-ed84710f-7ce9-4a3f-ae94-c778bf439039'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:21.819758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bf79152f8a46d7b9ac4cd585052ba4', 'request_id': 'req-ed84710f-7ce9-4a3f-ae94-c778bf439039'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:21.834034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] The token cache is being invalidate because project 07bf79152f8a46d7b9ac4cd585052ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:21.834588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:21.835250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed84710f-7ce9-4a3f-ae94-c778bf439039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:21.841213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 946/1867] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:21 2022] DELETE /identity/v3/projects/07bf79152f8a46d7b9ac4cd585052ba4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:21.842166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c47d79-a230-4b3c-a1e6-8e3cb260a6ab None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:21.842461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c47d79-a230-4b3c-a1e6-8e3cb260a6ab None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:21.842740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c47d79-a230-4b3c-a1e6-8e3cb260a6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:21.868565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-85c47d79-a230-4b3c-a1e6-8e3cb260a6ab None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:21.870052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-85c47d79-a230-4b3c-a1e6-8e3cb260a6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:21.937579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 947/1868] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:21.946749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d7767-04a0-4d8f-9cdd-3439153d40a2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:21.947043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d7767-04a0-4d8f-9cdd-3439153d40a2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:21.947497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d7767-04a0-4d8f-9cdd-3439153d40a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:21.978961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-521d7767-04a0-4d8f-9cdd-3439153d40a2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:21.980400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-521d7767-04a0-4d8f-9cdd-3439153d40a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:21.991546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 948/1869] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:21.995941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26cffa1f95f46a2b09c02a6f5f6bed8', 'request_id': 'req-53fe516e-63e2-4737-b1b7-325aac33a21c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.024519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d7767-04a0-4d8f-9cdd-3439153d40a2 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.032884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] The token cache is being invalidate because project c26cffa1f95f46a2b09c02a6f5f6bed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:22.033264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.034263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.038191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 922/1870] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:21 2022] DELETE /identity/v3/projects/c26cffa1f95f46a2b09c02a6f5f6bed8 => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:22.040658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.042990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:22.047137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d7767-04a0-4d8f-9cdd-3439153d40a2 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:22.053155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:22.054021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.056745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.056745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.056745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:22.056745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:22.057956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:22.076438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 949/1871] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:22.081071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.083210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:22.101826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b84cc-2477-4e33-b3fb-27cdf35fb35a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:22.117299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:22.118440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.118918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.119403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.120592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:22.124269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:22.128455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe516e-63e2-4737-b1b7-325aac33a21c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:22.134836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:22.135602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.135890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.136173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] PATH_INFO: `/v3/users/98a84f22f13f48998d5b531e42e388a5` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.137678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a84f22f13f48998d5b531e42e388a5)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:22.139722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:22.311859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:22.332160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 950/1872] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:22.336862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.414166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93594-c733-45ee-b86c-3a7a87c64470 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:22.419044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:22.419931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.425129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.425129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.425129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:22.425129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:22.529012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a84f22f13f48998d5b531e42e388a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.542287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a84f22f13f48998d5b531e42e388a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.575700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 951/1873] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:22 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:22.579667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.597712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01c265-5e15-4e7e-ad5e-c06d5bf80760 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:22.603410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:22.604049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.604499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.604928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.606133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:22.608434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:22.621200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 952/1874] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:22.625298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.637019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403583d-1121-4d0c-b0cf-cb60af20d98d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:22.642896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:22.644591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.645028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.645648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.646581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:22.648621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:22.672611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 953/1875] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:22.676763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a84f22f13f48998d5b531e42e388a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.677651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.677775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a84f22f13f48998d5b531e42e388a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.695475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e66a-5a9a-44a5-a67f-e622b528abb9 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:22.696150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a8b6733c-cca4-41ad-ab92-4252bf0302fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a84f22f13f48998d5b531e42e388a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:22.702046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:22.702789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.703081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.704072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] PATH_INFO: `/v3/projects/1177379831b040e1aeee5f5fd1332e66/users/2eb674f6c0e641f48e0ccfe6f3a404be/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.708016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 923/1876] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:22 2022] DELETE /identity/v3/users/98a84f22f13f48998d5b531e42e388a5 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:22.725049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1177379831b040e1aeee5f5fd1332e66, user_id=2eb674f6c0e641f48e0ccfe6f3a404be, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:22.729252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:22.807806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 954/1877] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:22 2022] PUT /identity/v3/projects/1177379831b040e1aeee5f5fd1332e66/users/2eb674f6c0e641f48e0ccfe6f3a404be/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:22.811310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:22.811859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:22.812297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:22.869800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] MFA Rules not processed for user `2eb674f6c0e641f48e0ccfe6f3a404be`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:22.872127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:22.953933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 924/1878] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:22.958804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:22.965179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:23.030451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.033382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:23.081396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6d61-85cd-460a-8d23-a7ee5d57ba2a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.091775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f0820-0d2f-4270-8f45-f28e260901f4 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.096079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.098155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.101110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.101110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.102749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.103249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.103978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.104214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.104494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] PATH_INFO: `/v3/projects/71be2d0b52c14f25a708f67ee7e23d96` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.108645 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71be2d0b52c14f25a708f67ee7e23d96)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.109745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.115025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.234113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 955/1879] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:22 2022] POST /identity/v3/projects => generated 379 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:23.237901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.252034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71be2d0b52c14f25a708f67ee7e23d96', 'request_id': 'req-ee8f318b-e425-415a-b2a5-5855a5607134'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:23.260312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71be2d0b52c14f25a708f67ee7e23d96', 'request_id': 'req-ee8f318b-e425-415a-b2a5-5855a5607134'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:23.319584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd0ae1-c748-475a-ab76-2de2f4ed60bd admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.324434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.325081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.325362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.325686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.326342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.328276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.411608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71be2d0b52c14f25a708f67ee7e23d96', 'request_id': 'req-ee8f318b-e425-415a-b2a5-5855a5607134'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:23.424452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] The token cache is being invalidate because project 71be2d0b52c14f25a708f67ee7e23d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:23.425409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:23.426096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee8f318b-e425-415a-b2a5-5855a5607134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:23.427667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 925/1880] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:23 2022] DELETE /identity/v3/projects/71be2d0b52c14f25a708f67ee7e23d96 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:23.432258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c635-c990-4ff8-aa71-e3c10bdf6312 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.432625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c635-c990-4ff8-aa71-e3c10bdf6312 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.437943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c635-c990-4ff8-aa71-e3c10bdf6312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.453019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ec15c635-c990-4ff8-aa71-e3c10bdf6312 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:23.454297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ec15c635-c990-4ff8-aa71-e3c10bdf6312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:23.462680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 926/1881] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:23.474440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c643-13fb-4cac-8c7d-38ed8ae1a134 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.475118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c643-13fb-4cac-8c7d-38ed8ae1a134 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.475118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c643-13fb-4cac-8c7d-38ed8ae1a134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.480543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 956/1882] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:23 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:23.484742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.486469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:23.498033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-cdc2c643-13fb-4cac-8c7d-38ed8ae1a134 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:23.499621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cdc2c643-13fb-4cac-8c7d-38ed8ae1a134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:23.499856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f252196-6d29-42e0-860f-824949af9808 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.514854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.526015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 927/1883] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:23.527136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2c643-13fb-4cac-8c7d-38ed8ae1a134 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.537912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.538373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.538660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.539433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.541390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.543982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2c643-13fb-4cac-8c7d-38ed8ae1a134 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.555483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.556477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.556918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.557947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.589661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:23.589661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.589661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.589986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 957/1884] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:23.590063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 928/1885] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:23.591775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.592403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.606894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87ab7-46f3-4fb9-a137-cc3fd6ca52ba admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.610710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027c2b7-6949-4088-8d52-fa5af0f57e75 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.614822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.615453 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.615734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.616006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.616683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.618541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.618916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.619502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.620209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.620673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] PATH_INFO: `/v3/projects/ddd62749d8c141b3be3bd861de7f9021/users/6e9b8fe95c5441ec90771e973ca48c5a/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.655404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd62749d8c141b3be3bd861de7f9021, user_id=6e9b8fe95c5441ec90771e973ca48c5a, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.661177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.807797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 929/1886] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:23 2022] PUT /identity/v3/projects/ddd62749d8c141b3be3bd861de7f9021/users/6e9b8fe95c5441ec90771e973ca48c5a/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:23.812673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 958/1887] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:23 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:23.824135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.824281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.916583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1948-4b83-4646-8319-e69e9fe126b3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.920164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe31b5-11ad-4883-87b5-fd116ed69198 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.921272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.921924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.922205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.922480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.922595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.923148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.923649 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.924003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.924289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.924992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.925851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.926661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.937359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 930/1888] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:23.941493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:23.951366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f86a-6268-48cc-8630-abde6b8829d2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:23.956643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb2b84-1045-44ea-baf4-552f44a8de3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:23.957311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2b84-1045-44ea-baf4-552f44a8de3c admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.957633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2b84-1045-44ea-baf4-552f44a8de3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.957919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2b84-1045-44ea-baf4-552f44a8de3c admin admin] PATH_INFO: `/v3/projects/ddd62749d8c141b3be3bd861de7f9021/users/6e9b8fe95c5441ec90771e973ca48c5a/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:23.959853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb2b84-1045-44ea-baf4-552f44a8de3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd62749d8c141b3be3bd861de7f9021, user_id=6e9b8fe95c5441ec90771e973ca48c5a, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:23.962571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb2b84-1045-44ea-baf4-552f44a8de3c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:23.975061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 931/1889] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:23 2022] PUT /identity/v3/projects/ddd62749d8c141b3be3bd861de7f9021/users/6e9b8fe95c5441ec90771e973ca48c5a/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:23.985558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:23.985849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:23.986125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.012979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] MFA Rules not processed for user `6e9b8fe95c5441ec90771e973ca48c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:24.014241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:24.035052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 959/1890] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:23 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:24.039133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.048710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e86d9-317d-473b-8282-bbcb2894f870 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.090047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 932/1891] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:24.102251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.103936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:24.116915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.117667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.118079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.118367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.119088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.120854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:24.132954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 960/1892] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:24.137424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.149058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e08a-5b39-4d5e-a453-02542433018b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.153950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.154925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.155222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.155709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.156417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.158071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:24.169989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 961/1893] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:24.174275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.174450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91808d02-65d3-4f72-b2c8-32f1f10b9d7f None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.179810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09b6dc-6660-41bb-a989-e32fe4cfc111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.180615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09b6dc-6660-41bb-a989-e32fe4cfc111 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.180969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09b6dc-6660-41bb-a989-e32fe4cfc111 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.181577 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09b6dc-6660-41bb-a989-e32fe4cfc111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.184366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2f09b6dc-6660-41bb-a989-e32fe4cfc111 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:24.189767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab296675-56c3-483a-b3db-984960731e34 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.195690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.197047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.197485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.198234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] PATH_INFO: `/v3/projects/1a56aab7310344a1b66cb675ef7a8c8c/users/f42fc32eab9544b28378ee5382334ec2/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.218637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a56aab7310344a1b66cb675ef7a8c8c, user_id=f42fc32eab9544b28378ee5382334ec2, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.223413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:24.260869 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09b6dc-6660-41bb-a989-e32fe4cfc111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.262453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09b6dc-6660-41bb-a989-e32fe4cfc111 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:24.274220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 933/1894] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:24.364130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 962/1895] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:24 2022] PUT /identity/v3/projects/1a56aab7310344a1b66cb675ef7a8c8c/users/f42fc32eab9544b28378ee5382334ec2/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:24.375523 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78eeed-c3e4-4c21-a719-a485f8225198 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.375815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78eeed-c3e4-4c21-a719-a485f8225198 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.376099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78eeed-c3e4-4c21-a719-a485f8225198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.435105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ae78eeed-c3e4-4c21-a719-a485f8225198 None None] MFA Rules not processed for user `f42fc32eab9544b28378ee5382334ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:24.436354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ae78eeed-c3e4-4c21-a719-a485f8225198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:24.517726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 934/1896] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:24.520285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.585309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c9705-01e2-44e8-a43d-928ef4de5cab admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.590254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.590880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.591159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.591435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.592098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.594058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:24.634965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:24.710820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 963/1897] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:24 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:24.714743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78eeed-c3e4-4c21-a719-a485f8225198 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.726096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78eeed-c3e4-4c21-a719-a485f8225198 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.781935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.782559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.782845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.783123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.783797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.795572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:24.891828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 935/1898] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:24 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:24.896498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.907566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f6635-258b-4969-8cdb-9b09ad0e85ac admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.917877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.917877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.917877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.917877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.918169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.918169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:24.934321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 964/1899] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:24.936804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:24.948146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ebf8d-f951-4255-81c3-712eaa44581c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:24.953092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:24.953899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:24.954185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:24.954482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] PATH_INFO: `/v3/projects/f41715d09f614040ad1582d6c3295cd0/users/4998d96cd9f74499ad2f70b0b2cb1b26/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:24.970449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41715d09f614040ad1582d6c3295cd0, user_id=4998d96cd9f74499ad2f70b0b2cb1b26, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:24.973301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:25.011970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:25.159521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 936/1900] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:24 2022] PUT /identity/v3/projects/f41715d09f614040ad1582d6c3295cd0/users/4998d96cd9f74499ad2f70b0b2cb1b26/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:25.164934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:25.189602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1414f-6f8b-4d9c-888b-c49c56448403 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:25.260714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280dff8-e313-4772-994f-ad20a6b95751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:25.261293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dff8-e313-4772-994f-ad20a6b95751 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:25.261785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dff8-e313-4772-994f-ad20a6b95751 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:25.265699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dff8-e313-4772-994f-ad20a6b95751 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:25.265699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280dff8-e313-4772-994f-ad20a6b95751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:25.265699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280dff8-e313-4772-994f-ad20a6b95751 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:25.282860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 965/1901] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:25.296969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:25.314205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a9bf-2094-450e-9827-018480ba0747 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:25.319243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:25.320083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:25.320555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:25.320956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] PATH_INFO: `/v3/projects/f41715d09f614040ad1582d6c3295cd0/users/4998d96cd9f74499ad2f70b0b2cb1b26/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:25.329338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41715d09f614040ad1582d6c3295cd0, user_id=4998d96cd9f74499ad2f70b0b2cb1b26, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:25.332341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:25.343538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 937/1902] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:25 2022] PUT /identity/v3/projects/f41715d09f614040ad1582d6c3295cd0/users/4998d96cd9f74499ad2f70b0b2cb1b26/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:25.366115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0622d3-2967-484d-a5cd-ac720f85e9b4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:25.366704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0622d3-2967-484d-a5cd-ac720f85e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:25.367076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0622d3-2967-484d-a5cd-ac720f85e9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:25.408069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4f0622d3-2967-484d-a5cd-ac720f85e9b4 None None] MFA Rules not processed for user `4998d96cd9f74499ad2f70b0b2cb1b26`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:25.408956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4f0622d3-2967-484d-a5cd-ac720f85e9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:25.481553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 966/1903] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:25.493854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:25.495612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:25.565557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf78ef-c81b-41db-9caa-c0b437fc8577 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:25.571935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:25.572944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:25.573423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:25.574084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:25.602880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:25.605346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:25.620281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 938/1904] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:25.715342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:25.997433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0622d3-2967-484d-a5cd-ac720f85e9b4 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:26.008479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0622d3-2967-484d-a5cd-ac720f85e9b4 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:26.012120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:26.012738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:26.013021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:26.013298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:26.070619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:26.072222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:26.082212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 967/1905] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:26.339809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:26.349333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5da40-6460-4ff2-a911-130c0ba0fc83 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:26.353787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b19e1-6ef7-4847-bf0f-6475d417cabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:26.354000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b19e1-6ef7-4847-bf0f-6475d417cabb service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:26.354288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b19e1-6ef7-4847-bf0f-6475d417cabb service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:26.354620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b19e1-6ef7-4847-bf0f-6475d417cabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:26.422239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b19e1-6ef7-4847-bf0f-6475d417cabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:26.423810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b19e1-6ef7-4847-bf0f-6475d417cabb service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:26.434227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 939/1906] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:26.764320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:26.943691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:29.505501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:30.017700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:31.827879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:32.015915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e98b-997f-47cf-ba7d-8887f0393268 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:32.024740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:32.026633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:32.027033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:32.028655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] PATH_INFO: `/v3/users/2eb674f6c0e641f48e0ccfe6f3a404be` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:32.031576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb674f6c0e641f48e0ccfe6f3a404be)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:32.036209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:32.298985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb674f6c0e641f48e0ccfe6f3a404be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:32.299857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb674f6c0e641f48e0ccfe6f3a404be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:32.300545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb674f6c0e641f48e0ccfe6f3a404be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:32.318203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb674f6c0e641f48e0ccfe6f3a404be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:32.360718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb674f6c0e641f48e0ccfe6f3a404be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:32.479459 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 968/1907] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:31 2022] DELETE /identity/v3/users/2eb674f6c0e641f48e0ccfe6f3a404be => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:32.483888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:32.484472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:32.484472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:32.522136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:32.525027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:32.610483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 940/1908] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:32.618206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:32.620284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:32.700297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbcba-b056-4773-b669-5adbbf651d6b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:32.706198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:32.706893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:32.707146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:32.707424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:32.726013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:32.727482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:32.741225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:32.742852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 969/1909] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:33.138362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:33.813217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:33.814731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:33.827893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134c4b-6950-45a1-b40e-33746fc2d2b6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:33.834668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:33.835614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:33.836165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:33.836636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] PATH_INFO: `/v3/projects/1177379831b040e1aeee5f5fd1332e66` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:33.838322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1177379831b040e1aeee5f5fd1332e66)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:33.840839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:33.975049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1177379831b040e1aeee5f5fd1332e66', 'request_id': 'req-0dc74287-e714-45dd-8d88-6093f13c3d7b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:33.981240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1177379831b040e1aeee5f5fd1332e66', 'request_id': 'req-0dc74287-e714-45dd-8d88-6093f13c3d7b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.049470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1177379831b040e1aeee5f5fd1332e66', 'request_id': 'req-0dc74287-e714-45dd-8d88-6093f13c3d7b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.063009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] The token cache is being invalidate because project 1177379831b040e1aeee5f5fd1332e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:34.063198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.063837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.065903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 941/1910] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:33 2022] DELETE /identity/v3/projects/1177379831b040e1aeee5f5fd1332e66 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:34.076891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:34.089131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed6fe6-ac68-4f30-ba54-1b8916cef7e2 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:34.146323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:34.147125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:34.147317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:34.147638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] PATH_INFO: `/v3/users/6e9b8fe95c5441ec90771e973ca48c5a` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:34.148827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9b8fe95c5441ec90771e973ca48c5a)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:34.150888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:34.421468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9b8fe95c5441ec90771e973ca48c5a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.422235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9b8fe95c5441ec90771e973ca48c5a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.422986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9b8fe95c5441ec90771e973ca48c5a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.432610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9b8fe95c5441ec90771e973ca48c5a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.447292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9b8fe95c5441ec90771e973ca48c5a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:34.529090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 970/1911] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:34 2022] DELETE /identity/v3/users/6e9b8fe95c5441ec90771e973ca48c5a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:35.041282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:35.042918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:35.080434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc74287-e714-45dd-8d88-6093f13c3d7b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:35.090653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:35.095353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:35.225497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:35.226353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:35.226587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb241-7f5e-431c-8a10-7b60bc8dc672 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:35.227034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:35.227034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] PATH_INFO: `/v3/projects/ddd62749d8c141b3be3bd861de7f9021` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:35.229183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd62749d8c141b3be3bd861de7f9021)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:35.231218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:35.236943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:35.237658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:35.237939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:35.238380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] PATH_INFO: `/v3/users/46bae01a32854ce0806e1721e34fc5fb` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:35.239727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bae01a32854ce0806e1721e34fc5fb)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:35.242396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:35.290052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:35.607617 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bae01a32854ce0806e1721e34fc5fb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.608474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bae01a32854ce0806e1721e34fc5fb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.609106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bae01a32854ce0806e1721e34fc5fb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.617410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bae01a32854ce0806e1721e34fc5fb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.619391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd62749d8c141b3be3bd861de7f9021', 'request_id': 'req-6dae38e2-5201-417d-8322-d564183b292d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.629303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd62749d8c141b3be3bd861de7f9021', 'request_id': 'req-6dae38e2-5201-417d-8322-d564183b292d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.635296 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2e6caec6-15a0-4e8a-b8b2-01e8a52ad287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bae01a32854ce0806e1721e34fc5fb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.753351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd62749d8c141b3be3bd861de7f9021', 'request_id': 'req-6dae38e2-5201-417d-8322-d564183b292d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.765757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] The token cache is being invalidate because project ddd62749d8c141b3be3bd861de7f9021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:35.765757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.766329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6dae38e2-5201-417d-8322-d564183b292d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:35.768216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 942/1912] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:35 2022] DELETE /identity/v3/projects/ddd62749d8c141b3be3bd861de7f9021 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:35.772937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99d422-3925-4d73-bda6-e9bf04257e4a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:35.773233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99d422-3925-4d73-bda6-e9bf04257e4a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:35.773534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99d422-3925-4d73-bda6-e9bf04257e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:35.781529 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:35.793235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2b99d422-3925-4d73-bda6-e9bf04257e4a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:35.795598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2b99d422-3925-4d73-bda6-e9bf04257e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:35.821597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 971/1913] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:35 2022] DELETE /identity/v3/users/46bae01a32854ce0806e1721e34fc5fb => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:35.826358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:35.826626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:35.826937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:35.846108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:35.847331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:35.855129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 943/1914] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:35.865325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017e17-245c-4ae7-b529-58042ff57b81 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:35.865719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017e17-245c-4ae7-b529-58042ff57b81 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:35.870189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017e17-245c-4ae7-b529-58042ff57b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:35.886119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-37017e17-245c-4ae7-b529-58042ff57b81 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:35.887256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-37017e17-245c-4ae7-b529-58042ff57b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:35.928477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 972/1915] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:35.938745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:35.940730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:35.950001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 944/1916] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:35.954213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37017e17-245c-4ae7-b529-58042ff57b81 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:35.963297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37017e17-245c-4ae7-b529-58042ff57b81 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:35.968104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:35.968764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:35.969052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:35.969332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:35.970080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:35.970392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:35.972063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:35.983994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 945/1917] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:59:35.993495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:35.999410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bcc8-fc9a-4619-b18c-942d68801320 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.004237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbb97-209f-4c5e-a9a9-6b6c54acb16a admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.004387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.004869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.005154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.005437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.009712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.010505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.010851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.011222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.012119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.014718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.015338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.016876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.027209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 973/1918] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:36.214366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 946/1919] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:35 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:36.218373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.229385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb9b67-6fc8-4714-ad1e-b4af3e91e08b service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.315355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.316039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.316939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.316939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.317281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.319432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.420656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 974/1920] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:36 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:36.425987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.436742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d946018-9eee-4a91-aa03-2becb460d4b9 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.441440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.443481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.443833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.444118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.445111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.447087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.458300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 947/1921] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:36.462298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.473321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b0814-9f9e-4e60-abb8-66c54939b93b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.478380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.484501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.484501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.484501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.484501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.484501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.492151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 975/1922] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:36.496437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.503648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:36.506870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6047e-313f-4196-9f7f-6b85ca74efb0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.511534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f43e1f-fd81-4180-90a4-c08465702912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.512211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43e1f-fd81-4180-90a4-c08465702912 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.512498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43e1f-fd81-4180-90a4-c08465702912 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.512823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43e1f-fd81-4180-90a4-c08465702912 admin admin] PATH_INFO: `/v3/projects/3b55fdfbbae0439dbc729a86597eb256/users/3ab46a75fb2647cd93878f0502935eaf/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.528378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f43e1f-fd81-4180-90a4-c08465702912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b55fdfbbae0439dbc729a86597eb256, user_id=3ab46a75fb2647cd93878f0502935eaf, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.531104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f43e1f-fd81-4180-90a4-c08465702912 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.567991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.569792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:36.584220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68d57-7f42-40f0-a09e-7dff9f00dce5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.589124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.589810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.590117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.590399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] PATH_INFO: `/v3/projects/21cb032d6bff4429b695252122a0f02e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.591632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cb032d6bff4429b695252122a0f02e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.593637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.662007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 948/1923] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:36 2022] PUT /identity/v3/projects/3b55fdfbbae0439dbc729a86597eb256/users/3ab46a75fb2647cd93878f0502935eaf/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:36.672004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27162ab1-9904-4228-961e-8d0d6755a140 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.672312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27162ab1-9904-4228-961e-8d0d6755a140 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.672625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27162ab1-9904-4228-961e-8d0d6755a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.704450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cb032d6bff4429b695252122a0f02e', 'request_id': 'req-0dffa12d-0356-43cb-8574-589f22708db9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:36.705284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-27162ab1-9904-4228-961e-8d0d6755a140 None None] MFA Rules not processed for user `3ab46a75fb2647cd93878f0502935eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:36.707725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-27162ab1-9904-4228-961e-8d0d6755a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:36.714284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cb032d6bff4429b695252122a0f02e', 'request_id': 'req-0dffa12d-0356-43cb-8574-589f22708db9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:36.785703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 949/1924] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:36.790751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27162ab1-9904-4228-961e-8d0d6755a140 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.828332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cb032d6bff4429b695252122a0f02e', 'request_id': 'req-0dffa12d-0356-43cb-8574-589f22708db9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:36.840618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] The token cache is being invalidate because project 21cb032d6bff4429b695252122a0f02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:36.840925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:36.841697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:36.846346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 976/1925] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:36 2022] DELETE /identity/v3/projects/21cb032d6bff4429b695252122a0f02e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:36.847431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.849094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:36.862936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27162ab1-9904-4228-961e-8d0d6755a140 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.863077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffa12d-0356-43cb-8574-589f22708db9 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:36.863362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.863989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.864278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.864557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.865235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.867215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.867502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:36.868148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:36.868438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:36.868713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] PATH_INFO: `/v3/users/d8c361a7eb3645e7b09a5b459743ad28` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:36.869933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c361a7eb3645e7b09a5b459743ad28)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:36.872669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:36.973013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 950/1926] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:36 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:36.978700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:36.980401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:37.047587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5703f-5991-4144-b03e-688f03c5a495 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:37.052625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:37.053264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.053575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.053858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.054671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:37.057945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:37.116625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c361a7eb3645e7b09a5b459743ad28'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:37.117285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c361a7eb3645e7b09a5b459743ad28'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:37.117909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c361a7eb3645e7b09a5b459743ad28'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:37.125526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c361a7eb3645e7b09a5b459743ad28'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:37.137836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c361a7eb3645e7b09a5b459743ad28'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:37.149139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 951/1927] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:36 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:37.153051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:37.154685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:37.166659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68a114-8911-4a6b-a2dd-a930d5fd763d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:37.171910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:37.172526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.172817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.173092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.173863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:37.176002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:37.186303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 952/1928] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:37.193431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:37.203018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e06c32-8fc7-442e-97e9-bcbdb4d1c3d0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:37.207627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:37.208277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.208561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.208838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] PATH_INFO: `/v3/projects/532c2bfaa49a4d8cb4bb7cea931349a4/users/0fade81767294ed49100ac7eeae78fb9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.215815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 977/1929] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:36 2022] DELETE /identity/v3/users/d8c361a7eb3645e7b09a5b459743ad28 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:37.224524 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532c2bfaa49a4d8cb4bb7cea931349a4, user_id=0fade81767294ed49100ac7eeae78fb9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:37.227341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:37.313932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 953/1930] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:37 2022] PUT /identity/v3/projects/532c2bfaa49a4d8cb4bb7cea931349a4/users/0fade81767294ed49100ac7eeae78fb9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:37.318654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:37.390358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564ed59-3afd-447b-aa97-dc6b052796ae admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:37.454246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794979f-51ef-41b1-bd48-075810ee2aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:37.454889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794979f-51ef-41b1-bd48-075810ee2aaa admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.455179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794979f-51ef-41b1-bd48-075810ee2aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.455517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794979f-51ef-41b1-bd48-075810ee2aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.456269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794979f-51ef-41b1-bd48-075810ee2aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:37.457966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794979f-51ef-41b1-bd48-075810ee2aaa admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:37.474093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 978/1931] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:37.477377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:37.492682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ada48-e62a-4f9e-a9be-85b081caf430 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:37.513725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:37.514454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.514758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.515030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] PATH_INFO: `/v3/projects/532c2bfaa49a4d8cb4bb7cea931349a4/users/0fade81767294ed49100ac7eeae78fb9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.518910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532c2bfaa49a4d8cb4bb7cea931349a4, user_id=0fade81767294ed49100ac7eeae78fb9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:37.521992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:37.537563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 954/1932] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:37 2022] PUT /identity/v3/projects/532c2bfaa49a4d8cb4bb7cea931349a4/users/0fade81767294ed49100ac7eeae78fb9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:37.546745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.547104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.547391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.579280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] MFA Rules not processed for user `0fade81767294ed49100ac7eeae78fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:37.580711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:37.652084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 979/1933] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:37.664851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:37.666754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:37.724253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87278791-f297-48c5-ac84-8e409bfc1ec8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:37.727848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:37.729305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:37.729485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9123e-9836-47ae-818d-408777dbdb81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:37.730198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9123e-9836-47ae-818d-408777dbdb81 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.730466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9123e-9836-47ae-818d-408777dbdb81 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.730756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9123e-9836-47ae-818d-408777dbdb81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.749022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9123e-9836-47ae-818d-408777dbdb81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:37.751126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9123e-9836-47ae-818d-408777dbdb81 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:37.767870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 955/1934] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:37.803110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bfdfe-5361-412d-aa13-fa3876be01a8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:37.809917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:37.810825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:37.811114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:37.811398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] PATH_INFO: `/v3/projects/a6fba1017c214b7da79ca17449a910e4` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:37.812695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fba1017c214b7da79ca17449a910e4)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:37.815418 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:37.816097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:37.951821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fba1017c214b7da79ca17449a910e4', 'request_id': 'req-ed9f5dee-f215-4788-be5b-3914e8af8bd2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:37.958972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fba1017c214b7da79ca17449a910e4', 'request_id': 'req-ed9f5dee-f215-4788-be5b-3914e8af8bd2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.068720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fba1017c214b7da79ca17449a910e4', 'request_id': 'req-ed9f5dee-f215-4788-be5b-3914e8af8bd2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.081932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] The token cache is being invalidate because project a6fba1017c214b7da79ca17449a910e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:38.082495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.083265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.085118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 980/1935] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:37 2022] DELETE /identity/v3/projects/a6fba1017c214b7da79ca17449a910e4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:38.090051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1b321-dd4e-4723-98b9-6ead69ef52e7 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.090422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1b321-dd4e-4723-98b9-6ead69ef52e7 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.090709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1b321-dd4e-4723-98b9-6ead69ef52e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.118170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-eed1b321-dd4e-4723-98b9-6ead69ef52e7 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:38.120920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.121074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-eed1b321-dd4e-4723-98b9-6ead69ef52e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:38.123064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:38.200491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 956/1936] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:38.203746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f5dee-f215-4788-be5b-3914e8af8bd2 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.209255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ca549-a185-4fbb-8d7d-8f9b9cd582d9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.209645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.209788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ca549-a185-4fbb-8d7d-8f9b9cd582d9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.210070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ca549-a185-4fbb-8d7d-8f9b9cd582d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.210313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.210594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.210874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] PATH_INFO: `/v3/users/f42fc32eab9544b28378ee5382334ec2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.212087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42fc32eab9544b28378ee5382334ec2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.214275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.232781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d02ca549-a185-4fbb-8d7d-8f9b9cd582d9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:38.234040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d02ca549-a185-4fbb-8d7d-8f9b9cd582d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:38.242484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 957/1937] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:38.246780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ca549-a185-4fbb-8d7d-8f9b9cd582d9 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.255901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ca549-a185-4fbb-8d7d-8f9b9cd582d9 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.260523 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.261170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.261459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.261766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.262466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:38.262771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.264391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.278084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 958/1938] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:59:38.282274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.293626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0334e4-999e-4a30-ad51-582b44e85037 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.298406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.299128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.299423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.299710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.300414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.302457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.588583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 959/1939] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:38 2022] POST /identity/v3/projects => generated 409 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:38.592792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.626055 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42fc32eab9544b28378ee5382334ec2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.627959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42fc32eab9544b28378ee5382334ec2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.628623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42fc32eab9544b28378ee5382334ec2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.638475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42fc32eab9544b28378ee5382334ec2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.651985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad721f1a-f092-4fca-b2dd-c4a596510751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42fc32eab9544b28378ee5382334ec2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:38.658820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7637aff-8d13-4ba8-ab60-87c246afd8ae admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.663563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.664195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.664486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.664768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.665474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.667518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.798865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 981/1940] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:38 2022] DELETE /identity/v3/users/f42fc32eab9544b28378ee5382334ec2 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:38.800505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 960/1941] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:38 2022] POST /identity/v3/users => generated 305 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:38.804762 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.805265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f0766-1deb-4c51-9961-3b096b30bcc0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.805588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f0766-1deb-4c51-9961-3b096b30bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.805875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f0766-1deb-4c51-9961-3b096b30bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.806445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:38.819506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f012f22-20f1-4107-8607-0c3d5f0c031e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.825695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-518f0766-1deb-4c51-9961-3b096b30bcc0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:38.826893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-518f0766-1deb-4c51-9961-3b096b30bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:38.876586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.876586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.876894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.876984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.878343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.879959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.885339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 982/1942] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:38.893423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 961/1943] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:38.894518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f0766-1deb-4c51-9961-3b096b30bcc0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.895204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.896967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:38.904169 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f0766-1deb-4c51-9961-3b096b30bcc0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.909057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.909743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.910073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.910427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.911198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.912804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.923226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 983/1944] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:38.927843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:38.937657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7371-d9f8-4866-a15c-57f23daba556 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.943824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.944505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.944794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.945077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] PATH_INFO: `/v3/projects/6f18fd5ef0ea4e53ad9e4666f81d1542/users/97cf704b7a8e49509d5018a29bbfbc5f/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.957664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd642-97e6-4ceb-a4ec-14ac7944be9b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:38.959910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f18fd5ef0ea4e53ad9e4666f81d1542, user_id=97cf704b7a8e49509d5018a29bbfbc5f, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.961310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33c99-8ae9-41c7-924f-78e82c93ce3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:38.961965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33c99-8ae9-41c7-924f-78e82c93ce3c service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:38.962255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33c99-8ae9-41c7-924f-78e82c93ce3c service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:38.963208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.963325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33c99-8ae9-41c7-924f-78e82c93ce3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:38.972324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33c99-8ae9-41c7-924f-78e82c93ce3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:38.973813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33c99-8ae9-41c7-924f-78e82c93ce3c service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:38.983130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 962/1945] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:39.167024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 984/1946] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:38 2022] PUT /identity/v3/projects/6f18fd5ef0ea4e53ad9e4666f81d1542/users/97cf704b7a8e49509d5018a29bbfbc5f/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:39.180463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873dc7-3b96-4717-9d3a-d5ea7a852ec5 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:39.180840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873dc7-3b96-4717-9d3a-d5ea7a852ec5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:39.181229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873dc7-3b96-4717-9d3a-d5ea7a852ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:39.220775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ac873dc7-3b96-4717-9d3a-d5ea7a852ec5 None None] MFA Rules not processed for user `97cf704b7a8e49509d5018a29bbfbc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:39.222275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ac873dc7-3b96-4717-9d3a-d5ea7a852ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:39.285178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:39.335549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 963/1947] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:39.336270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:39.410713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b8d2-b7b5-4959-b334-12ed579b0a18 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:39.416082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:39.416871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:39.417205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:39.417569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:39.418340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:39.420458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:39.766862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 985/1948] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:39 2022] POST /identity/v3/projects => generated 409 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:39.769212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac873dc7-3b96-4717-9d3a-d5ea7a852ec5 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:39.781879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac873dc7-3b96-4717-9d3a-d5ea7a852ec5 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:39.879779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:39.884217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:39.884217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:39.884217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:39.884217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:39.884217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:39.910572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:39.912383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:39.935083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a121b5-2e45-482d-9402-9a1438ad0641 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:39.945158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:39.945864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:39.946147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:39.946424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] PATH_INFO: `/v3/projects/1a56aab7310344a1b66cb675ef7a8c8c` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:39.947614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a56aab7310344a1b66cb675ef7a8c8c)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:39.949549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.000618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 964/1949] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:39 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:40.005923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.007859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:40.074611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c8059-b87d-462e-bcc8-02fa5b19fe6f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.079174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fade81767294ed49100ac7eeae78fb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532c2bfaa49a4d8cb4bb7cea931349a4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.079794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.080082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.080359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.081780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:40.082083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.083690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.096859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 965/1950] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:40.100291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.109708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a56aab7310344a1b66cb675ef7a8c8c', 'request_id': 'req-cb71eeae-f5bb-4a96-b493-fe76b3727382'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.110572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be822837-3769-4dd9-9be4-b2d5be502891 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.117179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a56aab7310344a1b66cb675ef7a8c8c', 'request_id': 'req-cb71eeae-f5bb-4a96-b493-fe76b3727382'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.173344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.174019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.174805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.175087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.175785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.177711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.182750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a56aab7310344a1b66cb675ef7a8c8c', 'request_id': 'req-cb71eeae-f5bb-4a96-b493-fe76b3727382'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.189620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 966/1951] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:40.193708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.200550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] The token cache is being invalidate because project 1a56aab7310344a1b66cb675ef7a8c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:40.200831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.201483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.203056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 986/1952] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:39 2022] DELETE /identity/v3/projects/1a56aab7310344a1b66cb675ef7a8c8c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:40.206869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.208724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:40.225874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71eeae-f5bb-4a96-b493-fe76b3727382 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.230709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.231398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.231713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.232005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] PATH_INFO: `/v3/projects/0fe5a33665f04eb0bd4fc479ab701492/users/7b661d6293a84b799698875a4bdb3094/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.248324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe5a33665f04eb0bd4fc479ab701492, user_id=7b661d6293a84b799698875a4bdb3094, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.251078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.260770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ed9a-c907-41a7-bdcc-584b45326a0f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.265786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fade81767294ed49100ac7eeae78fb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532c2bfaa49a4d8cb4bb7cea931349a4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.266531 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.266825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.267110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.267800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.269760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.395229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 987/1953] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:40 2022] PUT /identity/v3/projects/0fe5a33665f04eb0bd4fc479ab701492/users/7b661d6293a84b799698875a4bdb3094/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:40.396492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.398214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:40.428790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 967/1954] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:40 2022] POST /identity/v3/projects => generated 354 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:40.428790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.486355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f474fc4-dd22-4321-8d45-867fc95cf72c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.530016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af63cd-b998-4373-a0c5-4ea338deb338 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.542939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.542939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.542939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.542939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.543320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.543320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.571392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 968/1955] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:40.571392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.573287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:40.574290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.575039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.576797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.577275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] PATH_INFO: `/v3/users/4998d96cd9f74499ad2f70b0b2cb1b26` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.582928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4998d96cd9f74499ad2f70b0b2cb1b26)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.585072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.683233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf11c-7592-4b8b-bc65-c1827525f608 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.688228 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fade81767294ed49100ac7eeae78fb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532c2bfaa49a4d8cb4bb7cea931349a4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.696429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.696429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.696429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.696429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:40.696429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.697174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.705041 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 969/1956] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:40.706082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.716957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4480f-6fed-4682-a279-fe7d12d0ad69 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.722526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb640-a27f-4f02-8bb2-0756737a7693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.723189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb640-a27f-4f02-8bb2-0756737a7693 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.723467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb640-a27f-4f02-8bb2-0756737a7693 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.723761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb640-a27f-4f02-8bb2-0756737a7693 admin admin] PATH_INFO: `/v3/projects/0fe5a33665f04eb0bd4fc479ab701492/users/7b661d6293a84b799698875a4bdb3094/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.731775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb640-a27f-4f02-8bb2-0756737a7693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe5a33665f04eb0bd4fc479ab701492, user_id=7b661d6293a84b799698875a4bdb3094, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.731775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb640-a27f-4f02-8bb2-0756737a7693 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.740990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 970/1957] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:40 2022] PUT /identity/v3/projects/0fe5a33665f04eb0bd4fc479ab701492/users/7b661d6293a84b799698875a4bdb3094/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:40.751822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea018-84e1-4bd9-b8c6-6dc66a9552cb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.752110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea018-84e1-4bd9-b8c6-6dc66a9552cb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.752447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea018-84e1-4bd9-b8c6-6dc66a9552cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.779734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c59ea018-84e1-4bd9-b8c6-6dc66a9552cb None None] MFA Rules not processed for user `7b661d6293a84b799698875a4bdb3094`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:40.780954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c59ea018-84e1-4bd9-b8c6-6dc66a9552cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:40.850010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 971/1958] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:40.851056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea018-84e1-4bd9-b8c6-6dc66a9552cb None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:40.914764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea018-84e1-4bd9-b8c6-6dc66a9552cb None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:40.919365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fade81767294ed49100ac7eeae78fb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532c2bfaa49a4d8cb4bb7cea931349a4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:40.920065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:40.920359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:40.920752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] PATH_INFO: `/v3/projects/1dfff3b105414493ba28d853aa86fc8f` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:40.922211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1dfff3b105414493ba28d853aa86fc8f)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:40.926641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:40.933498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4998d96cd9f74499ad2f70b0b2cb1b26'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.934691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4998d96cd9f74499ad2f70b0b2cb1b26'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.935855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4998d96cd9f74499ad2f70b0b2cb1b26'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.948572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4998d96cd9f74499ad2f70b0b2cb1b26'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:40.966728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4998d96cd9f74499ad2f70b0b2cb1b26'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.044291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:41.102850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 988/1959] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:40 2022] DELETE /identity/v3/users/4998d96cd9f74499ad2f70b0b2cb1b26 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:41.104663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:41.106012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:41.129248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfff3b105414493ba28d853aa86fc8f', 'request_id': 'req-e96399ab-0055-4a53-ab51-458f7539c484'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.138426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfff3b105414493ba28d853aa86fc8f', 'request_id': 'req-e96399ab-0055-4a53-ab51-458f7539c484'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.198724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc393723-c426-4fe1-8488-a48855d00a04 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:41.251026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:41.251686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:41.251986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:41.252259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:41.254217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:41.262555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfff3b105414493ba28d853aa86fc8f', 'request_id': 'req-e96399ab-0055-4a53-ab51-458f7539c484'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.275621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] The token cache is being invalidate because project 1dfff3b105414493ba28d853aa86fc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:41.276403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.276638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.278467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 972/1960] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:40 2022] DELETE /identity/v3/projects/1dfff3b105414493ba28d853aa86fc8f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:41.322954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:41.324410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:41.334868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 989/1961] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:41.670584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:41.672250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:41.762568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96399ab-0055-4a53-ab51-458f7539c484 tempest-VolumeQuotaClassesTest-1843204026 tempest-VolumeQuotaClassesTest-1843204026-project-admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:41.767720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:41.768428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:41.768715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:41.768999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] PATH_INFO: `/v3/projects/f41715d09f614040ad1582d6c3295cd0` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:41.778577 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41715d09f614040ad1582d6c3295cd0)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:41.780868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:41.846611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:41.855143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950247f-e545-45e6-90bd-9d3f26b07407 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:41.858823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42f17-6c89-48d5-8e37-72af89373d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:41.859433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42f17-6c89-48d5-8e37-72af89373d6f service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:41.859716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42f17-6c89-48d5-8e37-72af89373d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:41.859989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42f17-6c89-48d5-8e37-72af89373d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:41.867133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-98c42f17-6c89-48d5-8e37-72af89373d6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:41.883025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41715d09f614040ad1582d6c3295cd0', 'request_id': 'req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.889202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41715d09f614040ad1582d6c3295cd0', 'request_id': 'req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.928891 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c42f17-6c89-48d5-8e37-72af89373d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:41.930475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c42f17-6c89-48d5-8e37-72af89373d6f service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:41.940606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 990/1962] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:41.965473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41715d09f614040ad1582d6c3295cd0', 'request_id': 'req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.978078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] The token cache is being invalidate because project f41715d09f614040ad1582d6c3295cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:41.978365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.979229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:41.980887 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 973/1963] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:41 2022] DELETE /identity/v3/projects/f41715d09f614040ad1582d6c3295cd0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:41.986054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326128c7-0f27-45cb-a8fd-0e37b385420e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:41.986357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326128c7-0f27-45cb-a8fd-0e37b385420e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:41.987168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326128c7-0f27-45cb-a8fd-0e37b385420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.007753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-326128c7-0f27-45cb-a8fd-0e37b385420e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:42.008998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-326128c7-0f27-45cb-a8fd-0e37b385420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:42.052066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:42.065079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.066757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:42.077012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 991/1964] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:42.092725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b8686-2194-4f94-afa1-508e10cd9338 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.093021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b8686-2194-4f94-afa1-508e10cd9338 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.093304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b8686-2194-4f94-afa1-508e10cd9338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.114431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-959b8686-2194-4f94-afa1-508e10cd9338 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:42.115605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-959b8686-2194-4f94-afa1-508e10cd9338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:42.128771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 992/1965] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:42.130075 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b8686-2194-4f94-afa1-508e10cd9338 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.134431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1cc6-ff7a-4bfd-8336-79928188cde1 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.142070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.142354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b8686-2194-4f94-afa1-508e10cd9338 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.142474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.142474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.142474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] PATH_INFO: `/v3/users/3ab46a75fb2647cd93878f0502935eaf` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.142474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab46a75fb2647cd93878f0502935eaf)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.143910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.144600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.145199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.145482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.145874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.146589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:42.146935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.148568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.161739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 993/1966] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:59:42.166033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.192528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a8a7-1c06-48db-835f-971c47a4f9a5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.194656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.195299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.195579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.195854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.196533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.198666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.367442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 994/1967] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:42 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:42.371288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.407614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab46a75fb2647cd93878f0502935eaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:42.415506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab46a75fb2647cd93878f0502935eaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:42.446548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1205-1f86-4026-9571-650da8f89879 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.451369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.451992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.452327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.452653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.453324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.455304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.598878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab46a75fb2647cd93878f0502935eaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:42.599572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab46a75fb2647cd93878f0502935eaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:42.613342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-448a7480-b731-4fbe-94bc-993889988b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab46a75fb2647cd93878f0502935eaf'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:42.619550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 974/1968] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:42 2022] DELETE /identity/v3/users/3ab46a75fb2647cd93878f0502935eaf => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:42.623855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.630941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.630941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.644249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:42.645476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:42.658865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 995/1969] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:42 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:42.662917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.664703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:42.677931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9ef6-d985-4f7e-a747-75a1e0f24a9f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.707576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 975/1970] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:42.721180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.722618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:42.740279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.740916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.741203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.741477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.742253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.743962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.754578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 996/1971] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:42.758606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.784822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1450d-2e90-4601-b9a2-9143347dd3ab admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.806795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.807643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.808027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.808483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.809604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.811478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.819400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d89d2-0bb6-40cf-a17c-a80ae4d23965 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.823366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fa4dd-a3be-4252-8c16-4bb3c462071b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.826740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fa4dd-a3be-4252-8c16-4bb3c462071b service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.827000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 997/1972] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:42.827090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fa4dd-a3be-4252-8c16-4bb3c462071b service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.827090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fa4dd-a3be-4252-8c16-4bb3c462071b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.829930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:42.840727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751dd6-564d-4041-a073-f16aff6a2af3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:42.847245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa257f-0e7d-45a4-a7d4-35700a9d9551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:42.850627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa257f-0e7d-45a4-a7d4-35700a9d9551 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.850946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa257f-0e7d-45a4-a7d4-35700a9d9551 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.868457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa257f-0e7d-45a4-a7d4-35700a9d9551 admin admin] PATH_INFO: `/v3/projects/230c953d37564daca83f7feb9aec1cb0/users/bcfb3869610e443ea9208f68c8081822/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.868873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fa4dd-a3be-4252-8c16-4bb3c462071b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.868873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fa4dd-a3be-4252-8c16-4bb3c462071b service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.871151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 976/1973] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:42.877962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa257f-0e7d-45a4-a7d4-35700a9d9551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230c953d37564daca83f7feb9aec1cb0, user_id=bcfb3869610e443ea9208f68c8081822, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:42.881372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa257f-0e7d-45a4-a7d4-35700a9d9551 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:42.906711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedb14b-8caa-4226-8795-fdaed927f2d3 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.907126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedb14b-8caa-4226-8795-fdaed927f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.907839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedb14b-8caa-4226-8795-fdaed927f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:42.927812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8cedb14b-8caa-4226-8795-fdaed927f2d3 None None] MFA Rules not processed for user `8087cdf690014a7b9e7bafcd8c8d7efe`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:42.929012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8cedb14b-8caa-4226-8795-fdaed927f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:42.996152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 998/1974] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:42 2022] PUT /identity/v3/projects/230c953d37564daca83f7feb9aec1cb0/users/bcfb3869610e443ea9208f68c8081822/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:42.998778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:42.999150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:42.999522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.010969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 977/1975] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:43.036049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] MFA Rules not processed for user `bcfb3869610e443ea9208f68c8081822`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:43.037409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:43.110755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 999/1976] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:43.115855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedb14b-8caa-4226-8795-fdaed927f2d3 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:43.127349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedb14b-8caa-4226-8795-fdaed927f2d3 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:43.196059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:43.197059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:43.197576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:43.198063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.199059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:43.201210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:43.366979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:43.368463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:43.370754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 978/1977] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:43 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:43.386164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:43.403081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770b8b-9916-44af-a52c-918789d292fe None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:43.472630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963a756-80da-4995-82ab-91e3b3c11412 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:43.477106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:43.477991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:43.478279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:43.478377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:43.478562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] PATH_INFO: `/v3/projects/3b55fdfbbae0439dbc729a86597eb256` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.479124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:43.479656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:43.480164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.480280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b55fdfbbae0439dbc729a86597eb256)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:43.481149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:43.482389 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:43.483333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:43.651883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 979/1978] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:43 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:43.655730 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:43.665352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039583-3ccf-4326-999a-122decba07f6 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:43.669959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:43.670555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:43.670846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:43.671133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.671847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:43.673738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:43.689397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 980/1979] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:43.691750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:43.696378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b55fdfbbae0439dbc729a86597eb256', 'request_id': 'req-4fb6043c-dcbf-4eca-ab66-9f587c716367'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:43.701850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7bd07-ac89-4dfa-88d8-caad2a817cf8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:43.702733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b55fdfbbae0439dbc729a86597eb256', 'request_id': 'req-4fb6043c-dcbf-4eca-ab66-9f587c716367'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:43.756557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:43.757240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:43.757545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:43.757827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] PATH_INFO: `/v3/projects/ee8b0a70a7884ff9b770fd6d1307bb04/users/a7ed7cdb0f7845cb9d5187757103d723/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.772578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8b0a70a7884ff9b770fd6d1307bb04, user_id=a7ed7cdb0f7845cb9d5187757103d723, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:43.775305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:43.840181 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b55fdfbbae0439dbc729a86597eb256', 'request_id': 'req-4fb6043c-dcbf-4eca-ab66-9f587c716367'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:43.854362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] The token cache is being invalidate because project 3b55fdfbbae0439dbc729a86597eb256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:43.854804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:43.855744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:43.857529 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1000/1980] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:43 2022] DELETE /identity/v3/projects/3b55fdfbbae0439dbc729a86597eb256 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:43.861335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:43.862847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:43.883100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 981/1981] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:43 2022] PUT /identity/v3/projects/ee8b0a70a7884ff9b770fd6d1307bb04/users/a7ed7cdb0f7845cb9d5187757103d723/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:43.894342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6043c-dcbf-4eca-ab66-9f587c716367 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:43.900703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:43.902820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:43.949467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:43.986416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5e004-4dc8-451b-8cbe-8637b13ba805 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:43.994065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:43.995120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:43.995410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:43.995698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.996147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:43.996614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:43.996938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:43.997417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:43.997750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] PATH_INFO: `/v3/users/0fade81767294ed49100ac7eeae78fb9` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:43.999023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fade81767294ed49100ac7eeae78fb9)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:44.001028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:44.001297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:44.015993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 982/1982] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:44.019864 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:44.031941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d8387-90c7-4381-99de-8241a938c4f0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:44.037352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef8db0-22f6-4a87-964f-51272aca541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:44.038068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8db0-22f6-4a87-964f-51272aca541a admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:44.038360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8db0-22f6-4a87-964f-51272aca541a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:44.038643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8db0-22f6-4a87-964f-51272aca541a admin admin] PATH_INFO: `/v3/projects/ee8b0a70a7884ff9b770fd6d1307bb04/users/a7ed7cdb0f7845cb9d5187757103d723/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:44.040639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef8db0-22f6-4a87-964f-51272aca541a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8b0a70a7884ff9b770fd6d1307bb04, user_id=a7ed7cdb0f7845cb9d5187757103d723, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:44.043678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef8db0-22f6-4a87-964f-51272aca541a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:44.054747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 983/1983] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:44 2022] PUT /identity/v3/projects/ee8b0a70a7884ff9b770fd6d1307bb04/users/a7ed7cdb0f7845cb9d5187757103d723/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:44.066002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:44.066295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:44.066573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:44.093916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] MFA Rules not processed for user `a7ed7cdb0f7845cb9d5187757103d723`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:44.095126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:44.176754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 984/1984] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:44.188502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:44.190588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:44.238820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fade81767294ed49100ac7eeae78fb9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:44.239472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fade81767294ed49100ac7eeae78fb9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:44.240247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fade81767294ed49100ac7eeae78fb9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:44.246453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0ca22-cff1-47da-92ce-04acdd4a18dc None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:44.247466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fade81767294ed49100ac7eeae78fb9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:44.251905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:44.253107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:44.253404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:44.253729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:44.255776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:44.263315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8feb576c-52c0-4525-8217-00324deeea67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fade81767294ed49100ac7eeae78fb9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:44.270856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:44.272320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:44.282509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 985/1985] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:44.350690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1001/1986] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:43 2022] DELETE /identity/v3/users/0fade81767294ed49100ac7eeae78fb9 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:44.360673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:44.362873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:44.440664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b13c4-b5f8-4bf8-98d0-f3c69b3e34e9 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:44.520622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:44.522288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:44.522288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:44.522288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] PATH_INFO: `/v3/users/bcfb3869610e443ea9208f68c8081822` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:44.528200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcfb3869610e443ea9208f68c8081822)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:44.530424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:44.977128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcfb3869610e443ea9208f68c8081822'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:44.988981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcfb3869610e443ea9208f68c8081822'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.069174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcfb3869610e443ea9208f68c8081822'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.070518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcfb3869610e443ea9208f68c8081822'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.086323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcfb3869610e443ea9208f68c8081822'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.094670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 986/1987] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:44 2022] DELETE /identity/v3/users/bcfb3869610e443ea9208f68c8081822 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:45.099999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:45.101040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:45.101040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:45.121927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:45.129409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:45.183870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1002/1988] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:45.197057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:45.198781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:45.208366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:45.212883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:45.225086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d7bf-7a10-44e1-a36d-c549a61d7394 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:45.229998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:45.230670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:45.230970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:45.231263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] PATH_INFO: `/v3/projects/532c2bfaa49a4d8cb4bb7cea931349a4` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:45.232660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] RBAC: Authorizing `identity:delete_project(project_id=532c2bfaa49a4d8cb4bb7cea931349a4)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:45.235212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:45.265616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b6c6-b939-4bb2-b439-d988459d7825 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:45.270148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2390-530d-4e7e-98e8-283420d66c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:45.270769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2390-530d-4e7e-98e8-283420d66c4f service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:45.271248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2390-530d-4e7e-98e8-283420d66c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:45.271538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2390-530d-4e7e-98e8-283420d66c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:45.288281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2390-530d-4e7e-98e8-283420d66c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:45.294555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2390-530d-4e7e-98e8-283420d66c4f service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:45.306947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 987/1989] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:45.425088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532c2bfaa49a4d8cb4bb7cea931349a4', 'request_id': 'req-e4c23694-5fb4-45fa-b370-2483efe4290f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.431670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532c2bfaa49a4d8cb4bb7cea931349a4', 'request_id': 'req-e4c23694-5fb4-45fa-b370-2483efe4290f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.643269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532c2bfaa49a4d8cb4bb7cea931349a4', 'request_id': 'req-e4c23694-5fb4-45fa-b370-2483efe4290f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.643269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:45.650710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] The token cache is being invalidate because project 532c2bfaa49a4d8cb4bb7cea931349a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:45.651023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.652147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e4c23694-5fb4-45fa-b370-2483efe4290f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:45.654230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1003/1990] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:45 2022] DELETE /identity/v3/projects/532c2bfaa49a4d8cb4bb7cea931349a4 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:45.658559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51f17-a7bb-4627-9156-dc66667276b0 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:45.659114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51f17-a7bb-4627-9156-dc66667276b0 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:45.659734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51f17-a7bb-4627-9156-dc66667276b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:45.688640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-23c51f17-a7bb-4627-9156-dc66667276b0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:45.688640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-23c51f17-a7bb-4627-9156-dc66667276b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:45.784166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 988/1991] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:45.787124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08079-8990-4669-ab86-2e95dcea2bfa None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:45.787757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08079-8990-4669-ab86-2e95dcea2bfa None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:45.787875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08079-8990-4669-ab86-2e95dcea2bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:45.812849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-07d08079-8990-4669-ab86-2e95dcea2bfa None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:45.814115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-07d08079-8990-4669-ab86-2e95dcea2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:45.822576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1004/1992] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:45.827363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51f17-a7bb-4627-9156-dc66667276b0 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:45.862632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51f17-a7bb-4627-9156-dc66667276b0 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:45.870151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:45.871123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:45.871810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:45.872166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:45.873256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:45.874831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:45.875400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:45.893868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 989/1993] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:45.901986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d08079-8990-4669-ab86-2e95dcea2bfa None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:45.906454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d08079-8990-4669-ab86-2e95dcea2bfa None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:45.919598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:45.919598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:45.919598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:45.919598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:45.920074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:45.922429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:46.030002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:46.033184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:46.060893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7a1b-28ed-453d-bf5f-985d8eed91cd admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:46.063392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1005/1994] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:45 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:46.068420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:46.187533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a96bb8-38ad-430d-b69a-cc623ea335cf admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:46.197437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:46.201328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:46.201841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:46.202304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:46.203188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:46.205393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:46.206587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:46.207367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:46.207750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:46.208194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] PATH_INFO: `/v3/projects/230c953d37564daca83f7feb9aec1cb0` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:46.209642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=230c953d37564daca83f7feb9aec1cb0)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:46.211738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:46.389991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1006/1995] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:46 2022] POST /identity/v3/users => generated 294 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:46.394238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:46.404400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3fe3-dfa4-4152-8f12-dab2ca48fb83 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:46.407548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230c953d37564daca83f7feb9aec1cb0', 'request_id': 'req-fce52e50-7053-44b0-b5e6-e87a183ab9e2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.411725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:46.416702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230c953d37564daca83f7feb9aec1cb0', 'request_id': 'req-fce52e50-7053-44b0-b5e6-e87a183ab9e2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.470549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:46.471244 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:46.471525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:46.471796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:46.472504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:46.474393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:46.487203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1007/1996] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:46.490053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230c953d37564daca83f7feb9aec1cb0', 'request_id': 'req-fce52e50-7053-44b0-b5e6-e87a183ab9e2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.498132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:46.519193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] The token cache is being invalidate because project 230c953d37564daca83f7feb9aec1cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:46.519497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.520489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.525641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 990/1997] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:46 2022] DELETE /identity/v3/projects/230c953d37564daca83f7feb9aec1cb0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:46.526136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c54076-e39a-40f3-b50d-d8c4d88f9c39 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:46.527856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:46.527992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:46.528561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:46.528947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:46.529228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:46.530008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:46.530196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:46.531647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:46.547427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce52e50-7053-44b0-b5e6-e87a183ab9e2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:46.549999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1008/1998] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:46.554922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:46.555849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:46.556124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:46.556406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] PATH_INFO: `/v3/users/a7ed7cdb0f7845cb9d5187757103d723` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:46.557801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ed7cdb0f7845cb9d5187757103d723)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:46.558252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:46.560106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:46.560735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:46.576827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e821fc7-867e-41e0-98d6-43bb24f41e8a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:46.590034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab8da4-565d-4b71-ad91-d8ba01aa59a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:46.590738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab8da4-565d-4b71-ad91-d8ba01aa59a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:46.591867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab8da4-565d-4b71-ad91-d8ba01aa59a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:46.591867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab8da4-565d-4b71-ad91-d8ba01aa59a0 admin admin] PATH_INFO: `/v3/projects/9ee20a8158074d65b693cf2e4acfd97a/users/9c3875ce40a141ddb2fd1ce40fd76548/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:46.609468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab8da4-565d-4b71-ad91-d8ba01aa59a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee20a8158074d65b693cf2e4acfd97a, user_id=9c3875ce40a141ddb2fd1ce40fd76548, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:46.612928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab8da4-565d-4b71-ad91-d8ba01aa59a0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:46.698219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1009/1999] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:46 2022] PUT /identity/v3/projects/9ee20a8158074d65b693cf2e4acfd97a/users/9c3875ce40a141ddb2fd1ce40fd76548/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:46.711950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f748698-f2d5-43f9-996a-eb419c82f05e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:46.712253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f748698-f2d5-43f9-996a-eb419c82f05e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:46.712539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f748698-f2d5-43f9-996a-eb419c82f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:46.757789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ed7cdb0f7845cb9d5187757103d723'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.770293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ed7cdb0f7845cb9d5187757103d723'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.771387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1f748698-f2d5-43f9-996a-eb419c82f05e None None] MFA Rules not processed for user `9c3875ce40a141ddb2fd1ce40fd76548`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:46.772662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1f748698-f2d5-43f9-996a-eb419c82f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:46.897281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ed7cdb0f7845cb9d5187757103d723'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.897956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ed7cdb0f7845cb9d5187757103d723'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.909056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1010/2000] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:46.910369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f748698-f2d5-43f9-996a-eb419c82f05e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:46.924294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ed7cdb0f7845cb9d5187757103d723'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:46.934801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 991/2001] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:46 2022] DELETE /identity/v3/users/a7ed7cdb0f7845cb9d5187757103d723 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:47.018890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f748698-f2d5-43f9-996a-eb419c82f05e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:47.115525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:47.116088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:47.117228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:47.117488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:47.122409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:47.122409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:47.261929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1011/2002] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:46 2022] POST /identity/v3/projects => generated 387 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:47.265398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:47.266756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:47.288856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131940-e0b5-4981-b8ef-412b8e0d7e20 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:47.338251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:47.381198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:47.382386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:47.384073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:47.384993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:47.388859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:47.396292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:47.542369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 992/2003] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:47 2022] POST /identity/v3/users => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:47.543663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:47.560959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c1fbc-83b2-4c75-a344-3fbc03ec0116 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:47.574248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:47.574610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:47.574844 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:47.575120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:47.576233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:47.577455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:47.594283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1012/2004] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:47.599482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:47.614579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650639-0230-4104-b59b-98febe41a4f6 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:47.621095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:47.621537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:47.621827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:47.622162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] PATH_INFO: `/v3/projects/afadce5669a941e7b7078370d86fd29b/users/a79cdc62018149eeb4711e898465d23a/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:47.646281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afadce5669a941e7b7078370d86fd29b, user_id=a79cdc62018149eeb4711e898465d23a, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:47.651339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:47.772568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 993/2005] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:47 2022] PUT /identity/v3/projects/afadce5669a941e7b7078370d86fd29b/users/a79cdc62018149eeb4711e898465d23a/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:47.776552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:47.787582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85202536-1a63-4ab0-914c-2f1b5ac7f019 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:47.864153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:47.875926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:47.878638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:47.895495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:47.895495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:47.895495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:47.895495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:47.895979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:47.906563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:47.919704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881123a-e84f-4685-a8cc-f503631f1884 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:47.951539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1013/2006] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:47.951660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:47.951660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:47.951832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:47.952095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] PATH_INFO: `/v3/projects/ee8b0a70a7884ff9b770fd6d1307bb04` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:47.954590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:47.961635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8b0a70a7884ff9b770fd6d1307bb04)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:47.964187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:47.985618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d619-6c55-4eec-b7cb-997d62aadb72 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:48.025901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103a587-744e-4fa7-927d-60ef3da642f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:48.026631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103a587-744e-4fa7-927d-60ef3da642f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.026925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103a587-744e-4fa7-927d-60ef3da642f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.027217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103a587-744e-4fa7-927d-60ef3da642f5 admin admin] PATH_INFO: `/v3/projects/afadce5669a941e7b7078370d86fd29b/users/a79cdc62018149eeb4711e898465d23a/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.038769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103a587-744e-4fa7-927d-60ef3da642f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afadce5669a941e7b7078370d86fd29b, user_id=a79cdc62018149eeb4711e898465d23a, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:48.054823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103a587-744e-4fa7-927d-60ef3da642f5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:48.109403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1014/2007] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:47 2022] PUT /identity/v3/projects/afadce5669a941e7b7078370d86fd29b/users/a79cdc62018149eeb4711e898465d23a/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:48.115210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.115649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.116034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.192218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] MFA Rules not processed for user `a79cdc62018149eeb4711e898465d23a`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:48.193646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:48.261742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8b0a70a7884ff9b770fd6d1307bb04', 'request_id': 'req-9fd7a8bc-8749-4619-afe3-71b141686b90'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:48.278824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8b0a70a7884ff9b770fd6d1307bb04', 'request_id': 'req-9fd7a8bc-8749-4619-afe3-71b141686b90'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:48.361685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1015/2008] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:48.389584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:48.391837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:48.438081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8b0a70a7884ff9b770fd6d1307bb04', 'request_id': 'req-9fd7a8bc-8749-4619-afe3-71b141686b90'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:48.451536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] The token cache is being invalidate because project ee8b0a70a7884ff9b770fd6d1307bb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:48.451862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:48.452594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9fd7a8bc-8749-4619-afe3-71b141686b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:48.456495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 994/2009] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:47 2022] DELETE /identity/v3/projects/ee8b0a70a7884ff9b770fd6d1307bb04 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:48.460901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003eda-e157-42e2-a3fb-b43b45647b6a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.461827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003eda-e157-42e2-a3fb-b43b45647b6a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.462196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003eda-e157-42e2-a3fb-b43b45647b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.486185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849add8a-5af4-41a9-bde0-8be92b7063fb None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:48.488977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dc003eda-e157-42e2-a3fb-b43b45647b6a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:48.490432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dc003eda-e157-42e2-a3fb-b43b45647b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:48.568228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:48.569247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.569846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.570312 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.573058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:48.599988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 995/2010] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:48.609292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc1d0-eabe-44f0-a368-81c1c36d53f4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.610479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc1d0-eabe-44f0-a368-81c1c36d53f4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.610971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc1d0-eabe-44f0-a368-81c1c36d53f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.634787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8f1fc1d0-eabe-44f0-a368-81c1c36d53f4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:48.636658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8f1fc1d0-eabe-44f0-a368-81c1c36d53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:48.661700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 996/2011] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:48.662701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fc1d0-eabe-44f0-a368-81c1c36d53f4 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:48.666152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:48.668011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:48.678046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fc1d0-eabe-44f0-a368-81c1c36d53f4 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:48.694203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1016/2012] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:48.694550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:48.694550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.694550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.694550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.694854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:48.694854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:48.696471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:48.716711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 997/2013] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:48.719063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:48.739826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02002f3-85a5-49ed-8131-95acbd6e7c66 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:48.754865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:48.755842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.755842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.756057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.756730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:48.758714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:48.765658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:48.883754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1017/2014] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:48 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:48.888632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:48.903198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6ac6c-7a89-4b8b-bbc1-4088c05ebf24 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:48.980429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:48.981681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:48.982348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:48.982834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:48.983849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:48.985891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:49.111859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 998/2015] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:48 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:49.113335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:49.125903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7e819-b748-48f1-9a37-05108535c3de admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:49.133379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:49.134059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:49.134352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:49.134726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:49.135437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:49.137808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:49.154134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1018/2016] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:49.155547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:49.179407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6735f-8e45-4368-839d-e32c9699464e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:49.188450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffee9cf-e949-4ded-8e08-9a3adf30b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:49.189188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee9cf-e949-4ded-8e08-9a3adf30b367 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:49.189620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee9cf-e949-4ded-8e08-9a3adf30b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:49.190527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee9cf-e949-4ded-8e08-9a3adf30b367 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:49.191346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee9cf-e949-4ded-8e08-9a3adf30b367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:49.193122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee9cf-e949-4ded-8e08-9a3adf30b367 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:49.209566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 999/2017] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:49.212157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:49.227263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c497-0a8e-4242-ae05-daba74bc3c17 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:49.234982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:49.236061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:49.237143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:49.237666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] PATH_INFO: `/v3/projects/bd86fc10facd44a68605c0692e76fc40/users/bd5cf0ba8ae645478cd17a2bb29dda2e/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:49.262080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd86fc10facd44a68605c0692e76fc40, user_id=bd5cf0ba8ae645478cd17a2bb29dda2e, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:49.265014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:49.372628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1019/2018] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:49 2022] PUT /identity/v3/projects/bd86fc10facd44a68605c0692e76fc40/users/bd5cf0ba8ae645478cd17a2bb29dda2e/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:49.390509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:49.390972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:49.391146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:49.473059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] MFA Rules not processed for user `bd5cf0ba8ae645478cd17a2bb29dda2e`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:49.484302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:49.492749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:49.591221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1000/2019] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:49.597057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:49.723624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50197531-c1ad-4df1-b9ab-02900101f437 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:49.731513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:49.731513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:49.731513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:49.731513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:49.732592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:49.738108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:49.783069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:49.785190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:49.817493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605996-fc62-4cb2-b226-4fe811c05665 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:49.834984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:49.835656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:49.835963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:49.836238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] PATH_INFO: `/v3/users/97cf704b7a8e49509d5018a29bbfbc5f` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:49.837440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cf704b7a8e49509d5018a29bbfbc5f)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:49.840426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:49.969739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1020/2020] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:49 2022] POST /identity/v3/projects => generated 375 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:49.971020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:50.015899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:50.114117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6e9e5-7ad3-4744-aae0-ff79f506213d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:50.127777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cf704b7a8e49509d5018a29bbfbc5f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.130270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:50.130930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:50.131222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:50.131501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:50.132802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:50.134993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:50.140859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cf704b7a8e49509d5018a29bbfbc5f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.267306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cf704b7a8e49509d5018a29bbfbc5f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.268490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cf704b7a8e49509d5018a29bbfbc5f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.291576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d6a78905-7e3f-4390-8dd5-8a720ec94235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cf704b7a8e49509d5018a29bbfbc5f'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.307333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1001/2021] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:49 2022] DELETE /identity/v3/users/97cf704b7a8e49509d5018a29bbfbc5f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:50.311561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:50.311913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:50.312204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:50.325588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1021/2022] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:49 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:50.331984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:50.338447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:50.358785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:50.360049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:50.364686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8c8c1-e5ac-4ac7-bd14-e6c29b1528d2 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:50.468331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1002/2023] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:50.476493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:50.477648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:50.477996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:50.478224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:50.478937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:50.480561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:50.489590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:50.491330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:50.495368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1022/2024] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:50.497251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:50.501273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:50.518646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cfb02-d76d-4270-8333-35c56ef4ac78 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:50.523548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:50.524201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:50.524488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:50.524765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] PATH_INFO: `/v3/users/9c3875ce40a141ddb2fd1ce40fd76548` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:50.525988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3875ce40a141ddb2fd1ce40fd76548)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:50.527930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:50.558381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72729-ef16-4975-b28d-c4853d5813bb None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:50.568464 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:50.572924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:50.572924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:50.572924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:50.579623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:50.581110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:50.590963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1003/2025] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:50.591767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:50.603366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773bd1-f3c3-44a2-971d-43d3f92ed9a7 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:50.607580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:50.608267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:50.608556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:50.608836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] PATH_INFO: `/v3/projects/51488ca34a784f53ba491a80d2c54245/users/7ab0fb1752db4bbbada1f9f798509df0/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:50.631559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51488ca34a784f53ba491a80d2c54245, user_id=7ab0fb1752db4bbbada1f9f798509df0, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:50.634509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:50.779446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1004/2026] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:50 2022] PUT /identity/v3/projects/51488ca34a784f53ba491a80d2c54245/users/7ab0fb1752db4bbbada1f9f798509df0/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:50.781031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:50.785921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:50.791951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3875ce40a141ddb2fd1ce40fd76548'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.793388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3875ce40a141ddb2fd1ce40fd76548'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.794790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3875ce40a141ddb2fd1ce40fd76548'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.813414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3875ce40a141ddb2fd1ce40fd76548'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.840114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3875ce40a141ddb2fd1ce40fd76548'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:50.882250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc025d-9dd3-4254-9160-cff720ad2930 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:50.888422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:50.889217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:50.889612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:50.890078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] PATH_INFO: `/v3/users/debe5286d7c344de97c61686195507ee` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:50.891527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=debe5286d7c344de97c61686195507ee)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:50.894239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:50.954832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1023/2027] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:50 2022] DELETE /identity/v3/users/9c3875ce40a141ddb2fd1ce40fd76548 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:50.957185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:50.959968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.037894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae244ad-660a-4ac5-965c-93477a27a55c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:51.042575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6163c-146b-46b3-b497-311d5d9bcc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:51.043160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6163c-146b-46b3-b497-311d5d9bcc78 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.043452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6163c-146b-46b3-b497-311d5d9bcc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.043732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6163c-146b-46b3-b497-311d5d9bcc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.044641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6163c-146b-46b3-b497-311d5d9bcc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:51.046460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6163c-146b-46b3-b497-311d5d9bcc78 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:51.060760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1024/2028] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:51.060760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fa963-9473-4120-aacf-fdaf87e2eb8d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.060760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fa963-9473-4120-aacf-fdaf87e2eb8d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.060760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fa963-9473-4120-aacf-fdaf87e2eb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.079700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-3a1fa963-9473-4120-aacf-fdaf87e2eb8d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:51.081641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3a1fa963-9473-4120-aacf-fdaf87e2eb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.089705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1025/2029] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:51.090517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fa963-9473-4120-aacf-fdaf87e2eb8d None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:51.100954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fa963-9473-4120-aacf-fdaf87e2eb8d None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:51.110182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:51.110182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.110182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.110182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] PATH_INFO: `/v3/projects/51488ca34a784f53ba491a80d2c54245/users/7ab0fb1752db4bbbada1f9f798509df0/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.111352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51488ca34a784f53ba491a80d2c54245, user_id=7ab0fb1752db4bbbada1f9f798509df0, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:51.114276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:51.125387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1026/2030] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:51 2022] PUT /identity/v3/projects/51488ca34a784f53ba491a80d2c54245/users/7ab0fb1752db4bbbada1f9f798509df0/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:51.126474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:51.134350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.174754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'debe5286d7c344de97c61686195507ee'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.183014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'debe5286d7c344de97c61686195507ee'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.215219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c065-9a61-4e01-9a47-d222eb613b81 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:51.218929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:51.219566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.219847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.220132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.284159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:51.285590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:51.295599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1027/2031] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:51.296460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:51.297865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.303822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'debe5286d7c344de97c61686195507ee'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.304878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'debe5286d7c344de97c61686195507ee'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.312003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae1572-3947-46de-922d-0045cdd1c109 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:51.317142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:51.318639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.318639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.318639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] PATH_INFO: `/v3/projects/6f18fd5ef0ea4e53ad9e4666f81d1542` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.320439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f18fd5ef0ea4e53ad9e4666f81d1542)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:51.320837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd7126b6-d820-45c4-a3f4-c4c70a8cf555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'debe5286d7c344de97c61686195507ee'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.322638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:51.327754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1005/2032] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:50 2022] DELETE /identity/v3/users/debe5286d7c344de97c61686195507ee => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:51.329016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.329309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.329625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.362356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] MFA Rules not processed for user `7ab0fb1752db4bbbada1f9f798509df0`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:51.363782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.447404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1006/2033] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:51.455684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:51.457140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.518585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb846b-d0ec-411a-8798-910203e0bcc2 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:51.523529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:51.524157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.524442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.524717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.526505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.582744 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f18fd5ef0ea4e53ad9e4666f81d1542', 'request_id': 'req-459f9f75-cf5c-4be0-bf32-a3033eb4974b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.594393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f18fd5ef0ea4e53ad9e4666f81d1542', 'request_id': 'req-459f9f75-cf5c-4be0-bf32-a3033eb4974b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.605495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:51.607558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:51.618231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1007/2034] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:51.708742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f18fd5ef0ea4e53ad9e4666f81d1542', 'request_id': 'req-459f9f75-cf5c-4be0-bf32-a3033eb4974b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.716441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:51.718046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.728391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] The token cache is being invalidate because project 6f18fd5ef0ea4e53ad9e4666f81d1542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:51.728696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.729791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:51.735997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1028/2035] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:51 2022] DELETE /identity/v3/projects/6f18fd5ef0ea4e53ad9e4666f81d1542 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:51.740950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:51.743542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:51.796666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4453cf-7426-4f73-84af-ef710f6dc3d2 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:51.825746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9f75-cf5c-4be0-bf32-a3033eb4974b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:51.831052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:51.831708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.831995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.832274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] PATH_INFO: `/v3/users/7b661d6293a84b799698875a4bdb3094` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.833460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b661d6293a84b799698875a4bdb3094)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:51.835462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:51.856224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:51.856883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:51.857158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:51.857432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] PATH_INFO: `/v3/projects/64a75a8e4ea541fcb5e618f65495dc7f` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:51.858673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a75a8e4ea541fcb5e618f65495dc7f)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:51.860605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:52.146916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b661d6293a84b799698875a4bdb3094'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.149552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b661d6293a84b799698875a4bdb3094'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.149663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a75a8e4ea541fcb5e618f65495dc7f', 'request_id': 'req-606e2359-5c5d-4d8c-a31c-129970f2857b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.149758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b661d6293a84b799698875a4bdb3094'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.154540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a75a8e4ea541fcb5e618f65495dc7f', 'request_id': 'req-606e2359-5c5d-4d8c-a31c-129970f2857b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.155925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b661d6293a84b799698875a4bdb3094'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.172406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a93755d3-f27d-4464-b164-bc73c9341fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b661d6293a84b799698875a4bdb3094'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.274733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a75a8e4ea541fcb5e618f65495dc7f', 'request_id': 'req-606e2359-5c5d-4d8c-a31c-129970f2857b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.289225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] The token cache is being invalidate because project 64a75a8e4ea541fcb5e618f65495dc7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:52.289551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.290682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.292369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:52.297040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1008/2036] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:51 2022] DELETE /identity/v3/projects/64a75a8e4ea541fcb5e618f65495dc7f => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:52.298112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:52.299586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:52.372237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e2359-5c5d-4d8c-a31c-129970f2857b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:52.378204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:52.378871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:52.379159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:52.379436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] PATH_INFO: `/v3/projects/9ee20a8158074d65b693cf2e4acfd97a` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:52.380633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee20a8158074d65b693cf2e4acfd97a)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:52.382758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:52.390666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1029/2037] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:51 2022] DELETE /identity/v3/users/7b661d6293a84b799698875a4bdb3094 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:52.392541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faf0df-5c7b-4f78-9fb2-d8956fa9123e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:52.393319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faf0df-5c7b-4f78-9fb2-d8956fa9123e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:52.402832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faf0df-5c7b-4f78-9fb2-d8956fa9123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:52.435991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-69faf0df-5c7b-4f78-9fb2-d8956fa9123e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:52.437342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-69faf0df-5c7b-4f78-9fb2-d8956fa9123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:52.499784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1030/2038] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:52.507567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5d01-3dca-4001-ae0d-12351b151ae5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:52.507855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5d01-3dca-4001-ae0d-12351b151ae5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:52.508134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5d01-3dca-4001-ae0d-12351b151ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:52.527563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d2ef5d01-3dca-4001-ae0d-12351b151ae5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:52.529637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d2ef5d01-3dca-4001-ae0d-12351b151ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:52.537131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1031/2039] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:52.541265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef5d01-3dca-4001-ae0d-12351b151ae5 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:52.550072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef5d01-3dca-4001-ae0d-12351b151ae5 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:52.554594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:52.555180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:52.555463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:52.555739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:52.556510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:52.556818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:52.558442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:52.572342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1032/2040] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:59:52.575077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:52.585433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba3585-2cb3-488e-8ce1-ae57a784bee4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:52.607760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee20a8158074d65b693cf2e4acfd97a', 'request_id': 'req-21dd7673-e8c2-41f9-ab23-f10bc51c46af'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.613729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee20a8158074d65b693cf2e4acfd97a', 'request_id': 'req-21dd7673-e8c2-41f9-ab23-f10bc51c46af'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.659235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:52.659927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:52.660205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:52.660485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:52.661429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:52.663223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:52.732010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee20a8158074d65b693cf2e4acfd97a', 'request_id': 'req-21dd7673-e8c2-41f9-ab23-f10bc51c46af'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.746558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] The token cache is being invalidate because project 9ee20a8158074d65b693cf2e4acfd97a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:52.746558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.746558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:52.747350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1009/2041] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:52 2022] DELETE /identity/v3/projects/9ee20a8158074d65b693cf2e4acfd97a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:52.751012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:52.752972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:52.766870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7673-e8c2-41f9-ab23-f10bc51c46af admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:52.773185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:52.773966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:52.774253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:52.774532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] PATH_INFO: `/v3/users/a79cdc62018149eeb4711e898465d23a` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:52.775792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79cdc62018149eeb4711e898465d23a)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:52.777903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:52.791061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1033/2042] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:52 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:52.795079 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:52.798523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:52.867372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb10c4a-23c1-492f-93f3-8524f9fc144e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:52.869440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:52.872382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:52.873004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:52.873289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:52.873599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:52.879445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:52.879445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.048120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1034/2043] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:52 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:53.049887 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.052568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.060858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79cdc62018149eeb4711e898465d23a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.070684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79cdc62018149eeb4711e898465d23a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.073209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be80d22-1a17-4071-8d8d-77f6260f4896 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.079173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.079637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.079738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.080014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] PATH_INFO: `/v3/projects/0fe5a33665f04eb0bd4fc479ab701492` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.081167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe5a33665f04eb0bd4fc479ab701492)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.083191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.162004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79cdc62018149eeb4711e898465d23a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.162765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79cdc62018149eeb4711e898465d23a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.175579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79cdc62018149eeb4711e898465d23a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.181659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1010/2044] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:52 2022] DELETE /identity/v3/users/a79cdc62018149eeb4711e898465d23a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:53.183986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.183986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.207354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe5a33665f04eb0bd4fc479ab701492', 'request_id': 'req-a351a821-13c1-4adf-912c-cb30f5668b7a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.215559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe5a33665f04eb0bd4fc479ab701492', 'request_id': 'req-a351a821-13c1-4adf-912c-cb30f5668b7a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.254578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c8d2-e979-40e5-a28b-45f1a59be363 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.295677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe5a33665f04eb0bd4fc479ab701492', 'request_id': 'req-a351a821-13c1-4adf-912c-cb30f5668b7a'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.307789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] The token cache is being invalidate because project 0fe5a33665f04eb0bd4fc479ab701492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:53.308171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.308763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a351a821-13c1-4adf-912c-cb30f5668b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.310873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1035/2045] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:53 2022] DELETE /identity/v3/projects/0fe5a33665f04eb0bd4fc479ab701492 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:53.316355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2f1c-b933-4fcf-811c-41e998e1c9b4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.316648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2f1c-b933-4fcf-811c-41e998e1c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.316928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2f1c-b933-4fcf-811c-41e998e1c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.318161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.318817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.319099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.319546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.320105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.321712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.332701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1011/2046] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:53.336761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-07af2f1c-b933-4fcf-811c-41e998e1c9b4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:53.336999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.338027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-07af2f1c-b933-4fcf-811c-41e998e1c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.338755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.347326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1036/2047] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:53.355003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049d1e-682a-432b-893b-ed8b7928a035 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.355161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75dcd-3e51-4d8b-8c5b-76f72d87ffea admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.355401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049d1e-682a-432b-893b-ed8b7928a035 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.355561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049d1e-682a-432b-893b-ed8b7928a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.372040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.372683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.372967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.373244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.374475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.377170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.377899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b3049d1e-682a-432b-893b-ed8b7928a035 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:53.379182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b3049d1e-682a-432b-893b-ed8b7928a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.391780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1012/2048] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:53.392718 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1037/2049] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:53.392901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.393720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3049d1e-682a-432b-893b-ed8b7928a035 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.406143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e49f94-208d-4eaa-a694-605a156ec5ef admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.406953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3049d1e-682a-432b-893b-ed8b7928a035 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.413942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04b378-1bea-4fe2-9283-8ff7b95c9767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.415153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b378-1bea-4fe2-9283-8ff7b95c9767 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.415380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.415978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.416427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.416783 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.417384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b378-1bea-4fe2-9283-8ff7b95c9767 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.418101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b378-1bea-4fe2-9283-8ff7b95c9767 admin admin] PATH_INFO: `/v3/projects/51795690a8c343019d4cf99bbcfd4054/users/6a4cc8dc12fe459cb46bd1ea5ce42f6e/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.418217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:53.418733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.421104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.435603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1013/2050] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:59:53.440379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.441944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04b378-1bea-4fe2-9283-8ff7b95c9767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51795690a8c343019d4cf99bbcfd4054, user_id=6a4cc8dc12fe459cb46bd1ea5ce42f6e, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.444851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04b378-1bea-4fe2-9283-8ff7b95c9767 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.452639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5870a7-98b5-44ef-958b-647267102fe5 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.459817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377777-2477-459d-a55d-da191a324325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.464796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377777-2477-459d-a55d-da191a324325 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.464796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377777-2477-459d-a55d-da191a324325 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.464796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377777-2477-459d-a55d-da191a324325 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.464796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377777-2477-459d-a55d-da191a324325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.464796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377777-2477-459d-a55d-da191a324325 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.519230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1038/2051] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:53 2022] PUT /identity/v3/projects/51795690a8c343019d4cf99bbcfd4054/users/6a4cc8dc12fe459cb46bd1ea5ce42f6e/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:53.524062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.524352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.524632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.544161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:53.545357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.608958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1039/2052] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:53.617863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1014/2053] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:53 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:53.628162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.628162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.630573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377777-2477-459d-a55d-da191a324325 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.704870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377777-2477-459d-a55d-da191a324325 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.705010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61b07d-380c-43f3-83ac-0450a76bf148 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.712114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.712114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.712114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.712503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.713297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.715773 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.768670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.769303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.769659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.769921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.780430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.781896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.792859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1040/2054] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:53.797561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.797561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:53.809072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f1fc-5f78-4a7b-b777-583d4d548a24 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.816839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.817817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.818282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.818563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] PATH_INFO: `/v3/projects/afadce5669a941e7b7078370d86fd29b` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.820353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afadce5669a941e7b7078370d86fd29b)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.822524 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.857613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1015/2055] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:53 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:53.861999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.872492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fa57-784e-4688-899a-499968a19e73 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.878577 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.879426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.880317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.880597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.881300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.882982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.894713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1016/2056] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:53.898833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.909638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9428-907c-4706-8907-607f11c896b8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.914780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.915615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.915901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.916181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.916880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.918752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.930053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1017/2057] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:53.933913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:53.944857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a84053-26f6-4bce-9698-f474491b2417 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:53.952418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43839b96-73c1-4f0f-a563-bbc58156f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:53.953064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839b96-73c1-4f0f-a563-bbc58156f105 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:53.953349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839b96-73c1-4f0f-a563-bbc58156f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:53.953669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839b96-73c1-4f0f-a563-bbc58156f105 admin admin] PATH_INFO: `/v3/projects/eb2dd8ef14ab49ac9ff8cc164dfaf92b/users/e02d30d28e23466e85dad2af0f879903/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:53.969845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afadce5669a941e7b7078370d86fd29b', 'request_id': 'req-80b6c983-0560-4aca-bb27-6a878c5ba224'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:53.972495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43839b96-73c1-4f0f-a563-bbc58156f105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2dd8ef14ab49ac9ff8cc164dfaf92b, user_id=e02d30d28e23466e85dad2af0f879903, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:53.975412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43839b96-73c1-4f0f-a563-bbc58156f105 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:53.976730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afadce5669a941e7b7078370d86fd29b', 'request_id': 'req-80b6c983-0560-4aca-bb27-6a878c5ba224'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:54.074542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:54.074724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afadce5669a941e7b7078370d86fd29b', 'request_id': 'req-80b6c983-0560-4aca-bb27-6a878c5ba224'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:54.080779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1018/2058] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:53 2022] PUT /identity/v3/projects/eb2dd8ef14ab49ac9ff8cc164dfaf92b/users/e02d30d28e23466e85dad2af0f879903/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:54.103131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] The token cache is being invalidate because project afadce5669a941e7b7078370d86fd29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:54.103782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:54.104659 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-80b6c983-0560-4aca-bb27-6a878c5ba224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:54.105290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.105552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.105724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.106878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1041/2059] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:53 2022] DELETE /identity/v3/projects/afadce5669a941e7b7078370d86fd29b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:54.112727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48394302-6090-4b5b-b00b-a2bdd7805799 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.113310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48394302-6090-4b5b-b00b-a2bdd7805799 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.114013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48394302-6090-4b5b-b00b-a2bdd7805799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.134464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-48394302-6090-4b5b-b00b-a2bdd7805799 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:54.135609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] MFA Rules not processed for user `e02d30d28e23466e85dad2af0f879903`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:54.135754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-48394302-6090-4b5b-b00b-a2bdd7805799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:54.137208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:54.203339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1042/2060] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:54.210220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1019/2061] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:54.211074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b82b4f-13c0-476e-bf2c-6ac03f6536d0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.211375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b82b4f-13c0-476e-bf2c-6ac03f6536d0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.211684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b82b4f-13c0-476e-bf2c-6ac03f6536d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.214208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.217699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:54.233877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-48b82b4f-13c0-476e-bf2c-6ac03f6536d0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:54.234255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6af748-54b5-4dfd-af0c-ddc20713df77 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.235100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-48b82b4f-13c0-476e-bf2c-6ac03f6536d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:54.240586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.240953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.241392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.241778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.242562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.257113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1043/2062] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:54.258279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.261144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b82b4f-13c0-476e-bf2c-6ac03f6536d0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.272030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b82b4f-13c0-476e-bf2c-6ac03f6536d0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.281330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.282020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.282309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.282588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.283888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:54.284202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.285905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.305152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1044/2063] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:54.311790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.319528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3ab90-22cc-45c7-8095-1c7b903d9d5e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.324439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.325291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.325610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.325897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.326565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.328475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.368088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1020/2064] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:54.372024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.435750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b80a9-de44-4a87-a384-04612d4dbe5a admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.440461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.441123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.441416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.441741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.442421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.445788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.461785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:54.471707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1045/2065] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:54.475787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.540732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bcaf1-46a7-4859-8ffa-7b947e29151f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.545568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.546192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.546482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.546761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.547550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.549533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.630547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1021/2066] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:54.634530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.645363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e830b5-0838-4ea3-a691-513f6976fdc9 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.650272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.650969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.651283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.651560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.652266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.653916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.669145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1022/2067] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:54.671844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.682015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e7d2-81e3-489d-a195-4752e723ceb7 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.687685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.688296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.688578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.688858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.690568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.692266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.705782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1046/2068] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:54.706307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1023/2069] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:54.708925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.709096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.719297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa73e-b6ac-4b9a-867f-4449d30ef84f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.719497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e22b33-7523-4d87-ac0e-d97bc652e558 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.724909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.725785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880979-94e8-4845-80ce-433c376d402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.725965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.726184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.726494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.727112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.727734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880979-94e8-4845-80ce-433c376d402d admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.728034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880979-94e8-4845-80ce-433c376d402d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.728317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880979-94e8-4845-80ce-433c376d402d admin admin] PATH_INFO: `/v3/projects/9993d87f95ad4871b7c00bb1d2f21fab/users/2d77f0461b874fb5a00ac2ca902ea4f8/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.728775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.740157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1047/2070] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:54.744209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.751852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880979-94e8-4845-80ce-433c376d402d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9993d87f95ad4871b7c00bb1d2f21fab, user_id=2d77f0461b874fb5a00ac2ca902ea4f8, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.754795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880979-94e8-4845-80ce-433c376d402d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.755470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af63008-6202-4441-85ae-f72793499e99 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.761773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.762252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.762535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.762747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.763438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.765042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.777555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1048/2071] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:59:54.782035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:54.792223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2ea7e-2744-47a6-958e-e156ade6d971 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:54.796903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e707-5c1e-46d8-b6dd-d4402ed7dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:54.797599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e707-5c1e-46d8-b6dd-d4402ed7dcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.797888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e707-5c1e-46d8-b6dd-d4402ed7dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.798166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e707-5c1e-46d8-b6dd-d4402ed7dcc6 admin admin] PATH_INFO: `/v3/projects/39510d76b9c0464e9ead0ea78db5a0cc/users/1ef2232e2ff44fb8a611fae0e526a41e/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.813091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e707-5c1e-46d8-b6dd-d4402ed7dcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39510d76b9c0464e9ead0ea78db5a0cc, user_id=1ef2232e2ff44fb8a611fae0e526a41e, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:54.816349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e707-5c1e-46d8-b6dd-d4402ed7dcc6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:54.857994 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1024/2072] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:54 2022] PUT /identity/v3/projects/9993d87f95ad4871b7c00bb1d2f21fab/users/2d77f0461b874fb5a00ac2ca902ea4f8/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:54.875574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb043c-20d2-4b5e-be82-49412dc2527d None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:54.875867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb043c-20d2-4b5e-be82-49412dc2527d None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:54.876174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb043c-20d2-4b5e-be82-49412dc2527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:54.918240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-60eb043c-20d2-4b5e-be82-49412dc2527d None None] MFA Rules not processed for user `2d77f0461b874fb5a00ac2ca902ea4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:54.919539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-60eb043c-20d2-4b5e-be82-49412dc2527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:54.990109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1025/2073] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:54.994745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb043c-20d2-4b5e-be82-49412dc2527d None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.041129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1049/2074] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:54 2022] PUT /identity/v3/projects/39510d76b9c0464e9ead0ea78db5a0cc/users/1ef2232e2ff44fb8a611fae0e526a41e/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:59:55.054290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.054577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.054860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.060227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb043c-20d2-4b5e-be82-49412dc2527d None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:55.095809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] MFA Rules not processed for user `1ef2232e2ff44fb8a611fae0e526a41e`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:55.096906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:55.134388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:55.136849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.136849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.136849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.136849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:55.138597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:55.180915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1050/2075] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:59:55.182715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.185975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:55.208327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034962-8c89-4bed-be4d-e76b332edabd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:55.213971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:55.215076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.215560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.222782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] PATH_INFO: `/v3/users/bd5cf0ba8ae645478cd17a2bb29dda2e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.222782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5cf0ba8ae645478cd17a2bb29dda2e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:55.222782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:55.259623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1026/2076] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:54 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:59:55.260473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.262103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:55.347419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70835-ee6b-49aa-8980-2d2d81967d01 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:55.351317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:55.354012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.354012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.354012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.410834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:55.412288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:55.421632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1027/2077] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:55.422414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.485739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566a5d-206b-40b9-b554-1ead1c7f0b27 service glance] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:55.491921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:55.492547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.492833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.493110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.493992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:55.498027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:55.516155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5cf0ba8ae645478cd17a2bb29dda2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:55.517067 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5cf0ba8ae645478cd17a2bb29dda2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:55.518093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5cf0ba8ae645478cd17a2bb29dda2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:55.531739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5cf0ba8ae645478cd17a2bb29dda2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:55.548987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ed5f0392-a299-40b8-8b38-ca38adabfb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5cf0ba8ae645478cd17a2bb29dda2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:55.589137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1028/2078] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:55 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:55.591023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.593502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:55.611333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcfa59-3192-4233-bf73-812a9c03a8f3 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:55.616886 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:55.617596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.618120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.618320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.618919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:55.620674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:55.650817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1029/2079] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:55.660782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.665865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1051/2080] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:55 2022] DELETE /identity/v3/users/bd5cf0ba8ae645478cd17a2bb29dda2e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:55.671369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.671686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.671967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.679829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4ba65-d36b-4964-8da0-88782e0dac9d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:55.693450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:55.694702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:55.743238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:55.744186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.744623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.745080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] PATH_INFO: `/v3/projects/eb0295887a2649299655ecef7e7354ac/users/2eb4996b7fad4e04b802402c2309baa9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.761258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1052/2081] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:55.763179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0295887a2649299655ecef7e7354ac, user_id=2eb4996b7fad4e04b802402c2309baa9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:55.768044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:55.771799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.774272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:55.844636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d812a8-e5d6-462d-ae72-93316663f3cd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:55.848823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:55.849696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:55.849978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:55.850254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:55.860520 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:55.862809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:55.873249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1053/2082] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:55.900123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1030/2083] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:55 2022] PUT /identity/v3/projects/eb0295887a2649299655ecef7e7354ac/users/2eb4996b7fad4e04b802402c2309baa9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:55.906350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:55.920495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a1ea-cf50-4afe-b37a-7d2cbd2f6e6d service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:56.023799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d30a6-9c6f-4871-a3c9-45a89ec53183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:56.024433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d30a6-9c6f-4871-a3c9-45a89ec53183 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:56.024714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d30a6-9c6f-4871-a3c9-45a89ec53183 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:56.025269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d30a6-9c6f-4871-a3c9-45a89ec53183 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:56.025739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d30a6-9c6f-4871-a3c9-45a89ec53183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:56.027825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d30a6-9c6f-4871-a3c9-45a89ec53183 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:56.040574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1054/2084] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 15:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:59:56.044889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:56.061270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfbf2e-23a4-4cd7-b36c-4afd34454e93 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:56.067046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:56.069203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:56.069203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:56.069203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] PATH_INFO: `/v3/projects/eb0295887a2649299655ecef7e7354ac/users/2eb4996b7fad4e04b802402c2309baa9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:56.070407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0295887a2649299655ecef7e7354ac, user_id=2eb4996b7fad4e04b802402c2309baa9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:56.073641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:56.086795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1031/2085] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 15:59:56 2022] PUT /identity/v3/projects/eb0295887a2649299655ecef7e7354ac/users/2eb4996b7fad4e04b802402c2309baa9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:56.099723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:56.099723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:56.099723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:56.135076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] MFA Rules not processed for user `2eb4996b7fad4e04b802402c2309baa9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:56.136614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:56.217090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1055/2086] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:56.231184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:56.233823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:56.310601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc458a66-f632-4e9a-986d-ba8fc22aa586 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:56.316093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:56.316799 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:56.317091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:56.317372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:56.327652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:56.329176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:56.340363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1032/2087] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:56.471649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:56.480409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:56.534127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:56.548380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48edf16-f775-47e9-a0bb-14d7b88a197f service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:56.552577 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:56.553202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:56.553489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:56.553804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:56.555561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:56.648510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f845c-091d-4425-a645-717f4614dacd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:56.674564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:56.674564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:56.674564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:56.674564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] PATH_INFO: `/v3/projects/bd86fc10facd44a68605c0692e76fc40` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:56.674928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd86fc10facd44a68605c0692e76fc40)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:56.674928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:56.708821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:56.711184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:56.722167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1033/2088] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 15:59:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:59:56.961463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd86fc10facd44a68605c0692e76fc40', 'request_id': 'req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:56.969976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd86fc10facd44a68605c0692e76fc40', 'request_id': 'req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.075116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:57.119706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd86fc10facd44a68605c0692e76fc40', 'request_id': 'req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.134739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] The token cache is being invalidate because project bd86fc10facd44a68605c0692e76fc40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:57.135196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.135966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.138298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1056/2089] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:56 2022] DELETE /identity/v3/projects/bd86fc10facd44a68605c0692e76fc40 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:57.141830 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:57.160870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917b064-0963-4489-8fc5-6b70d358c935 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:57.248355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:57.248355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:57.248355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:57.248355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] PATH_INFO: `/v3/users/7ab0fb1752db4bbbada1f9f798509df0` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:57.249906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab0fb1752db4bbbada1f9f798509df0)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:57.251993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:57.636903 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab0fb1752db4bbbada1f9f798509df0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.648988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab0fb1752db4bbbada1f9f798509df0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.757056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab0fb1752db4bbbada1f9f798509df0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.758756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab0fb1752db4bbbada1f9f798509df0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.787939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-695447bb-506a-41e6-8b91-692ee1e12e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab0fb1752db4bbbada1f9f798509df0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:57.799295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1034/2090] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 15:59:57 2022] DELETE /identity/v3/users/7ab0fb1752db4bbbada1f9f798509df0 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:58.940093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:58.941802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:58.957167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd02ddd-1f0b-4b71-9a2a-47e70dcac2b1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:59.043126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:59.043797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:59.043979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:59.044353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] PATH_INFO: `/v3/projects/51488ca34a784f53ba491a80d2c54245` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:59.045634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51488ca34a784f53ba491a80d2c54245)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:59.047609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:59.298612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:59.318473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51488ca34a784f53ba491a80d2c54245', 'request_id': 'req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:59.325943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51488ca34a784f53ba491a80d2c54245', 'request_id': 'req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:59.474403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51488ca34a784f53ba491a80d2c54245', 'request_id': 'req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:59.489928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] The token cache is being invalidate because project 51488ca34a784f53ba491a80d2c54245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:59:59.490216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:59.491331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-abe1256c-792c-4b3b-a4cc-9fd8e9f06bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:59:59.493051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1057/2091] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 15:59:58 2022] DELETE /identity/v3/projects/51488ca34a784f53ba491a80d2c54245 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:59:59.498211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d11ee-ba28-471d-9e6b-fa76bb584b4a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:59.498806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d11ee-ba28-471d-9e6b-fa76bb584b4a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:59.498916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d11ee-ba28-471d-9e6b-fa76bb584b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:59.522916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ff2d11ee-ba28-471d-9e6b-fa76bb584b4a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:59.524933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ff2d11ee-ba28-471d-9e6b-fa76bb584b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:59.607102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1035/2092] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:59.615855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f955-0559-43df-a16c-1ba566702b6c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:59.616342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f955-0559-43df-a16c-1ba566702b6c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:59.616696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f955-0559-43df-a16c-1ba566702b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:59.639739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-f0a4f955-0559-43df-a16c-1ba566702b6c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:59:59.641830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f0a4f955-0559-43df-a16c-1ba566702b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:59.655375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1058/2093] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:59:59.667169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d11ee-ba28-471d-9e6b-fa76bb584b4a None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:59.683161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d11ee-ba28-471d-9e6b-fa76bb584b4a None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:59.688638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:59.690364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:59.690364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:59.690858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:59.691533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:59:59.691855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:59.694023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:59.708812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1036/2094] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 15:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:59:59.713768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4f955-0559-43df-a16c-1ba566702b6c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:59.724424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4f955-0559-43df-a16c-1ba566702b6c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:59.730359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:59.731027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:59.731493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:59.731778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:59.732475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:59.735208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:59.858443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1059/2095] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 15:59:59 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:59:59.865305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:59.893841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad167-56b0-409f-a219-1e0da5141826 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:59.999825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:00.000463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:00.000751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:00.001032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:00.001732 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:00.006982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:00.200690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1037/2096] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 15:59:59 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:00.207463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:00.235460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdbaa9-0d62-47de-bbae-45bf237d9bf4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:00.245236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:00.245957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:00.246271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:00.250600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:00.250600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:00.250600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:00.271597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:00.283870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1060/2097] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:00.286339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05540-53f1-40f3-a1aa-5cd029a91c4f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:00.291363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753235c-17fe-40df-85ec-b3aaad75dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:00.292423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753235c-17fe-40df-85ec-b3aaad75dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:00.292561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753235c-17fe-40df-85ec-b3aaad75dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:00.292776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753235c-17fe-40df-85ec-b3aaad75dd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:00.293540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753235c-17fe-40df-85ec-b3aaad75dd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:00.303836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753235c-17fe-40df-85ec-b3aaad75dd2b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:00.317136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1038/2098] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:00:00.321892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:00.333607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eade1d-11e1-4f34-8375-8b2223fe74d6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:00.347281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:00.348133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:00.349053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:00.349053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] PATH_INFO: `/v3/projects/add6cf8683774b4793737918c31be0aa/users/cb3b634248fb4e968d07d6db6280ad65/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:00.371167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add6cf8683774b4793737918c31be0aa, user_id=cb3b634248fb4e968d07d6db6280ad65, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:00.375346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:00.391395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:00.594393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1061/2099] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:00 2022] PUT /identity/v3/projects/add6cf8683774b4793737918c31be0aa/users/cb3b634248fb4e968d07d6db6280ad65/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:00.605250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f4225-d27c-41e6-a548-8a8752023e76 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:00.605824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f4225-d27c-41e6-a548-8a8752023e76 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:00.605943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f4225-d27c-41e6-a548-8a8752023e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:00.649071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-080f4225-d27c-41e6-a548-8a8752023e76 None None] MFA Rules not processed for user `cb3b634248fb4e968d07d6db6280ad65`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:00.651912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-080f4225-d27c-41e6-a548-8a8752023e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:00.736664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1039/2100] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:00.741113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:00.822686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107313a4-d0a9-4cb6-b948-340214aa3e47 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:00.833683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:00.834560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:00.834849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:00.835125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:00.835804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:00.840146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:01.005025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1062/2101] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:00 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:01.010874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f4225-d27c-41e6-a548-8a8752023e76 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:01.029130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f4225-d27c-41e6-a548-8a8752023e76 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:01.126004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:01.126687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:01.138060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:01.138060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:01.138060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:01.138060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:01.261299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1040/2102] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:01 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:01.267395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:01.280712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686fbd-d758-4886-9ab4-696bca6a5419 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:01.293485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:01.295338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:01.296000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:01.305693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:01.306771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:01.311545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:01.326292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1063/2103] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:01.330566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:01.341599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300c4c-489c-4f2e-b783-a95b032ed232 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:01.347661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b44b5-e0f9-447b-9b57-e92e3107977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:01.348306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b44b5-e0f9-447b-9b57-e92e3107977c admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:01.348594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b44b5-e0f9-447b-9b57-e92e3107977c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:01.354111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b44b5-e0f9-447b-9b57-e92e3107977c admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:01.354111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b44b5-e0f9-447b-9b57-e92e3107977c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:01.354111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b44b5-e0f9-447b-9b57-e92e3107977c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:01.385165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1041/2104] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:01.389220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:01.403156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb91c-a757-4d3d-aa76-5f229e816195 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:01.410702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:01.411395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:01.411771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:01.412121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] PATH_INFO: `/v3/projects/d219c1bb68994d9db1c37b108cfaf9f7/users/eca48d2e7ce446f3bd6a243f905ee809/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:01.444244 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d219c1bb68994d9db1c37b108cfaf9f7, user_id=eca48d2e7ce446f3bd6a243f905ee809, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:01.454829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:01.590823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1064/2105] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:01 2022] PUT /identity/v3/projects/d219c1bb68994d9db1c37b108cfaf9f7/users/eca48d2e7ce446f3bd6a243f905ee809/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:01.672927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415a423-b78a-4796-a224-eddbdf3c49ca None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:01.673475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415a423-b78a-4796-a224-eddbdf3c49ca None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:01.673584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415a423-b78a-4796-a224-eddbdf3c49ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:01.737877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e415a423-b78a-4796-a224-eddbdf3c49ca None None] MFA Rules not processed for user `eca48d2e7ce446f3bd6a243f905ee809`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:01.739078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e415a423-b78a-4796-a224-eddbdf3c49ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:01.854573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1042/2106] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:01.856983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:02.005801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948a8-8b7a-46e8-9328-435958fc3595 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:02.026638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb90ec-42c5-47b5-a817-ebdd7a1d0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:02.039975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb90ec-42c5-47b5-a817-ebdd7a1d0dbf admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.040371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb90ec-42c5-47b5-a817-ebdd7a1d0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.040806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb90ec-42c5-47b5-a817-ebdd7a1d0dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.042182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb90ec-42c5-47b5-a817-ebdd7a1d0dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:02.045637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb90ec-42c5-47b5-a817-ebdd7a1d0dbf admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:02.252578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1065/2107] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:01 2022] POST /identity/v3/projects => generated 377 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:02.256685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415a423-b78a-4796-a224-eddbdf3c49ca None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:02.269303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415a423-b78a-4796-a224-eddbdf3c49ca None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:02.354964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:02.356106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.357122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.357864 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.358152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:02.360138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:02.430868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.431368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.431460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.462802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] MFA Rules not processed for user `6a4cc8dc12fe459cb46bd1ea5ce42f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:02.464345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:02.492400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1043/2108] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:02 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:02.497496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:02.509608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868fa0-5e01-4876-a59b-6e3f2c7125ab admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:02.514662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:02.515341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.515628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.515909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.516607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:02.519214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:02.540230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1044/2109] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:02.543906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:02.558814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1066/2110] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:02.562891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b6529-8304-434a-a87c-d67271dc790e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:02.571574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:02.572363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.572760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.573139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] PATH_INFO: `/v3/projects/87d54dd16f8544d58d62f440427dd4b9/users/42aac783723547e2b665ac782343c2ec/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.576742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:02.578327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:02.594828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d54dd16f8544d58d62f440427dd4b9, user_id=42aac783723547e2b665ac782343c2ec, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:02.597736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:02.623661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:02.660336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8320-5f06-48e8-a406-7c93b80e9b86 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:02.666374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:02.671972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.671972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.671972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.677070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:02.678935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:02.688583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1067/2111] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:00:02.760919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1045/2112] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:02 2022] PUT /identity/v3/projects/87d54dd16f8544d58d62f440427dd4b9/users/42aac783723547e2b665ac782343c2ec/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:02.765307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:02.776193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a426-ed15-4755-8266-40dd1517da66 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:02.848690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36985a-c20f-405f-aa56-d1f7e58ca747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:02.849294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36985a-c20f-405f-aa56-d1f7e58ca747 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.855753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36985a-c20f-405f-aa56-d1f7e58ca747 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.855753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36985a-c20f-405f-aa56-d1f7e58ca747 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.855753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36985a-c20f-405f-aa56-d1f7e58ca747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:02.855753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36985a-c20f-405f-aa56-d1f7e58ca747 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:02.868536 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1068/2113] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:02.869750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:02.883673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2a496-f37e-4abc-a3ff-75597060eed0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:02.891004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:02.891004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.891312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.891537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] PATH_INFO: `/v3/projects/87d54dd16f8544d58d62f440427dd4b9/users/42aac783723547e2b665ac782343c2ec/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.893662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d54dd16f8544d58d62f440427dd4b9, user_id=42aac783723547e2b665ac782343c2ec, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:02.896494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:02.914583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1046/2114] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:02 2022] PUT /identity/v3/projects/87d54dd16f8544d58d62f440427dd4b9/users/42aac783723547e2b665ac782343c2ec/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:02.922643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:02.922643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:02.922643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:02.954762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] MFA Rules not processed for user `42aac783723547e2b665ac782343c2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:02.956188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:03.054816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1069/2115] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:03.069988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:03.072162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:03.137087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c81b6-6ebc-4f31-a707-f87375d3fd2c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:03.141008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf23c-8ca7-488e-9b11-a882a47f0bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:03.141728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf23c-8ca7-488e-9b11-a882a47f0bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:03.142013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf23c-8ca7-488e-9b11-a882a47f0bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:03.142316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf23c-8ca7-488e-9b11-a882a47f0bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:03.227484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf23c-8ca7-488e-9b11-a882a47f0bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:03.229793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf23c-8ca7-488e-9b11-a882a47f0bf5 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:03.244020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1047/2116] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:00:03.257466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:03.470503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:03.472678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:03.542824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8a1d-625e-40ee-90ea-83a07c5580a8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:03.547593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:03.548411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:03.548719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:03.549010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] PATH_INFO: `/v3/users/e02d30d28e23466e85dad2af0f879903` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:03.551083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02d30d28e23466e85dad2af0f879903)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:03.553102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:03.873918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02d30d28e23466e85dad2af0f879903'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:03.874786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02d30d28e23466e85dad2af0f879903'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:03.875497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02d30d28e23466e85dad2af0f879903'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:03.883146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02d30d28e23466e85dad2af0f879903'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:03.904445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02d30d28e23466e85dad2af0f879903'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:04.069809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1070/2117] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:03 2022] DELETE /identity/v3/users/e02d30d28e23466e85dad2af0f879903 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:04.074981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:04.075432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:04.075751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:04.102314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:04.102832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:04.196751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1048/2118] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:04.207544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:04.210589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:04.334156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440acd25-9acc-49b2-8ff0-24e41cb848eb admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:04.339089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:04.339786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:04.340150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:04.340497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:04.355062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:04.357054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:04.369349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1071/2119] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:04.593442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:05.008040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:05.023885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:05.070034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6230-ed25-4620-b2b2-65af1cd420c4 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:05.078920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:05.080330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:05.080797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:05.081755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] PATH_INFO: `/v3/projects/eb2dd8ef14ab49ac9ff8cc164dfaf92b` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:05.087585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2dd8ef14ab49ac9ff8cc164dfaf92b)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:05.091297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:05.298309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2dd8ef14ab49ac9ff8cc164dfaf92b', 'request_id': 'req-c8857374-0883-4f44-b00d-600ee7ea9ab5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:05.305410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2dd8ef14ab49ac9ff8cc164dfaf92b', 'request_id': 'req-c8857374-0883-4f44-b00d-600ee7ea9ab5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:05.468589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2dd8ef14ab49ac9ff8cc164dfaf92b', 'request_id': 'req-c8857374-0883-4f44-b00d-600ee7ea9ab5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:05.490321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] The token cache is being invalidate because project eb2dd8ef14ab49ac9ff8cc164dfaf92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:05.490614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:05.491684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:05.497496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1049/2120] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:05 2022] DELETE /identity/v3/projects/eb2dd8ef14ab49ac9ff8cc164dfaf92b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:05.503780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:05.531443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772daba9-0743-4de7-b818-bd72b68d5464 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:05.666017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:05.677210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:05.678152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:05.678623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:05.679100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] PATH_INFO: `/v3/users/2d77f0461b874fb5a00ac2ca902ea4f8` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:05.680789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d77f0461b874fb5a00ac2ca902ea4f8)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:05.683794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:05.862001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:05.865245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:05.999735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8857374-0883-4f44-b00d-600ee7ea9ab5 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:06.012369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6042cb-eca1-400b-aca3-3317502c6e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:06.013122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6042cb-eca1-400b-aca3-3317502c6e06 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:06.013440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6042cb-eca1-400b-aca3-3317502c6e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:06.013746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6042cb-eca1-400b-aca3-3317502c6e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:06.016569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bf6042cb-eca1-400b-aca3-3317502c6e06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:06.063380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d77f0461b874fb5a00ac2ca902ea4f8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:06.064201 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d77f0461b874fb5a00ac2ca902ea4f8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:06.065480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d77f0461b874fb5a00ac2ca902ea4f8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:06.093199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d77f0461b874fb5a00ac2ca902ea4f8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:06.115722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d77f0461b874fb5a00ac2ca902ea4f8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:06.164340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6042cb-eca1-400b-aca3-3317502c6e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:06.166133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6042cb-eca1-400b-aca3-3317502c6e06 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:06.180552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1050/2121] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:06.256527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1072/2122] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:05 2022] DELETE /identity/v3/users/2d77f0461b874fb5a00ac2ca902ea4f8 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:06.615819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368521-db68-43f2-a7e9-eadecda2bb94 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:06.616241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368521-db68-43f2-a7e9-eadecda2bb94 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:06.616599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368521-db68-43f2-a7e9-eadecda2bb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:06.671013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f6368521-db68-43f2-a7e9-eadecda2bb94 None None] MFA Rules not processed for user `6a4cc8dc12fe459cb46bd1ea5ce42f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:06.672517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f6368521-db68-43f2-a7e9-eadecda2bb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:06.765667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1051/2123] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:07.001811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:07.005950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:07.106746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddf23-b0e1-4acc-a2d6-bfe94a8fdc2c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:07.112031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:07.113252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:07.113560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:07.113856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] PATH_INFO: `/v3/projects/9993d87f95ad4871b7c00bb1d2f21fab` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:07.115218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9993d87f95ad4871b7c00bb1d2f21fab)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:07.117197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:07.264417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9993d87f95ad4871b7c00bb1d2f21fab', 'request_id': 'req-c78e6f3a-67c5-4643-b711-b1c155b6feba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.273721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9993d87f95ad4871b7c00bb1d2f21fab', 'request_id': 'req-c78e6f3a-67c5-4643-b711-b1c155b6feba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.434714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9993d87f95ad4871b7c00bb1d2f21fab', 'request_id': 'req-c78e6f3a-67c5-4643-b711-b1c155b6feba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.449714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] The token cache is being invalidate because project 9993d87f95ad4871b7c00bb1d2f21fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:07.450017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.450787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.452652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1073/2124] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:07 2022] DELETE /identity/v3/projects/9993d87f95ad4871b7c00bb1d2f21fab => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:07.457149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6368521-db68-43f2-a7e9-eadecda2bb94 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:07.478113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6368521-db68-43f2-a7e9-eadecda2bb94 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:07.559260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:07.560187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:07.560466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:07.560736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] PATH_INFO: `/v3/users/2eb4996b7fad4e04b802402c2309baa9` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:07.561950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb4996b7fad4e04b802402c2309baa9)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:07.564097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:07.854176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb4996b7fad4e04b802402c2309baa9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.865420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb4996b7fad4e04b802402c2309baa9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.943985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb4996b7fad4e04b802402c2309baa9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.946130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb4996b7fad4e04b802402c2309baa9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.968072 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb4996b7fad4e04b802402c2309baa9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:07.978397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1052/2125] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:07 2022] DELETE /identity/v3/users/2eb4996b7fad4e04b802402c2309baa9 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:08.432971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:08.446412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:08.509774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e6f3a-67c5-4643-b711-b1c155b6feba admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:08.574347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d9d35-36ba-451f-80b8-6c6a637f3946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:08.574973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9d35-36ba-451f-80b8-6c6a637f3946 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:08.575251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9d35-36ba-451f-80b8-6c6a637f3946 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:08.575525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9d35-36ba-451f-80b8-6c6a637f3946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:08.577269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-121d9d35-36ba-451f-80b8-6c6a637f3946 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:08.648171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9d35-36ba-451f-80b8-6c6a637f3946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:08.650299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9d35-36ba-451f-80b8-6c6a637f3946 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:08.651284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:08.652865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:08.663778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1074/2126] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:00:08.735537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49840d6-0201-43e1-8ec7-cead0bab3757 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:08.740713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:08.741386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:08.741711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:08.741996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] PATH_INFO: `/v3/projects/eb0295887a2649299655ecef7e7354ac` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:08.743329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0295887a2649299655ecef7e7354ac)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:08.745325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:08.926550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0295887a2649299655ecef7e7354ac', 'request_id': 'req-69fea3eb-2848-4617-85e4-f438c4209f15'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:08.933166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0295887a2649299655ecef7e7354ac', 'request_id': 'req-69fea3eb-2848-4617-85e4-f438c4209f15'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:09.034973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0295887a2649299655ecef7e7354ac', 'request_id': 'req-69fea3eb-2848-4617-85e4-f438c4209f15'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:09.047113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] The token cache is being invalidate because project eb0295887a2649299655ecef7e7354ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:09.047404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:09.048057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-69fea3eb-2848-4617-85e4-f438c4209f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:09.049932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1053/2127] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:08 2022] DELETE /identity/v3/projects/eb0295887a2649299655ecef7e7354ac => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:00:09.056867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c841-0515-459a-ba7b-70c3b57a3e22 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.057155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c841-0515-459a-ba7b-70c3b57a3e22 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.057436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c841-0515-459a-ba7b-70c3b57a3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.078686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2c25c841-0515-459a-ba7b-70c3b57a3e22 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:09.079903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2c25c841-0515-459a-ba7b-70c3b57a3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:09.147562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1075/2128] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:09.157788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe182e7-f22c-465c-9eda-49730d247eae None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.158068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe182e7-f22c-465c-9eda-49730d247eae None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.158396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe182e7-f22c-465c-9eda-49730d247eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.180900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dbe182e7-f22c-465c-9eda-49730d247eae None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:09.182247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dbe182e7-f22c-465c-9eda-49730d247eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:09.191202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1054/2129] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:09.196468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25c841-0515-459a-ba7b-70c3b57a3e22 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:09.211310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25c841-0515-459a-ba7b-70c3b57a3e22 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:09.218569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:09.219295 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.219582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.219863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.220592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:00:09.220902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:09.223290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:09.243712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1076/2130] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:00:09.250136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe182e7-f22c-465c-9eda-49730d247eae None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:09.259937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe182e7-f22c-465c-9eda-49730d247eae None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:09.265428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:09.266026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.266310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.267566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.268534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:09.271547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:09.410039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1055/2131] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:09 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:09.411751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:09.422541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9e41e-7f7a-43bc-9874-37ac1a48c583 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:09.512545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:09.512545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.512545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.512545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.513869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:09.513869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:09.569929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:09.677423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1077/2132] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:09 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:09.680513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:09.691335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecea11-f94c-4207-a534-2e51ad23261f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:09.695917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:09.696539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.696824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.697103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.697834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:09.699441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:09.712605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1056/2133] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:09.715729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:09.728997 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a705c3-b75e-4de9-b1a5-cf7a26292acb admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:09.733965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b57a7-a862-4ce2-a74e-47e3b13345fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:09.734593 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b57a7-a862-4ce2-a74e-47e3b13345fb admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.734879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b57a7-a862-4ce2-a74e-47e3b13345fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.735177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b57a7-a862-4ce2-a74e-47e3b13345fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.735907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b57a7-a862-4ce2-a74e-47e3b13345fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:09.737574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b57a7-a862-4ce2-a74e-47e3b13345fb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:09.757476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1078/2134] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:09.763318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:09.775247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a361c-b6d4-46e2-9da6-9aad1b1c1a54 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:09.780334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:09.781337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.781810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.782288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] PATH_INFO: `/v3/projects/276fb2c40d7a48b78fa6179fa674e49b/users/59cd0f2eb737469db410929fe8530a3c/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.799519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276fb2c40d7a48b78fa6179fa674e49b, user_id=59cd0f2eb737469db410929fe8530a3c, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:09.802502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:09.920858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1057/2135] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:09 2022] PUT /identity/v3/projects/276fb2c40d7a48b78fa6179fa674e49b/users/59cd0f2eb737469db410929fe8530a3c/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:09.930126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fef63-8cd6-45ee-b89b-b0ef1d458c7f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:09.930448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fef63-8cd6-45ee-b89b-b0ef1d458c7f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:09.931703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fef63-8cd6-45ee-b89b-b0ef1d458c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:09.986310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-230fef63-8cd6-45ee-b89b-b0ef1d458c7f None None] MFA Rules not processed for user `59cd0f2eb737469db410929fe8530a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:09.988136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-230fef63-8cd6-45ee-b89b-b0ef1d458c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:10.117125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1079/2136] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:10.131561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:10.237971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2289-3848-4255-9b73-cc38ec8a67b2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:10.244653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:10.246224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:10.246688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:10.247178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:10.248302 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:10.250856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:10.261842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:10.390273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1058/2137] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:10 2022] POST /identity/v3/projects => generated 383 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:10.394646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fef63-8cd6-45ee-b89b-b0ef1d458c7f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:10.408021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fef63-8cd6-45ee-b89b-b0ef1d458c7f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:10.476423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:10.477054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:10.477334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:10.477646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:10.478337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:10.480458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:10.687566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1080/2138] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:10 2022] POST /identity/v3/users => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:10.693297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:10.705818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c778d4-a29c-4789-9ed5-17cb66ae1fc8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:10.713014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:10.714201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:10.715028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:10.715499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:10.716958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:10.719789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:10.735225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1059/2139] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:10.740275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:10.751195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881090a-941d-4e27-98c6-473251886f82 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:10.755938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:10.756735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:10.756966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:10.757248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] PATH_INFO: `/v3/projects/0d9500bcf60a43ac9dbaf25424b8f24a/users/d8e6521921b842af8ff18b66d0af10d5/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:10.772417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9500bcf60a43ac9dbaf25424b8f24a, user_id=d8e6521921b842af8ff18b66d0af10d5, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:10.775155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:10.959212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1081/2140] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:10 2022] PUT /identity/v3/projects/0d9500bcf60a43ac9dbaf25424b8f24a/users/d8e6521921b842af8ff18b66d0af10d5/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:10.964027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:10.974985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823a186-0f05-40d4-b790-c9811c066dc7 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:11.049342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b74a40-e9a1-490e-9ce2-826c8cf65697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:11.049998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b74a40-e9a1-490e-9ce2-826c8cf65697 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:11.050601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b74a40-e9a1-490e-9ce2-826c8cf65697 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:11.051021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b74a40-e9a1-490e-9ce2-826c8cf65697 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:11.055682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b74a40-e9a1-490e-9ce2-826c8cf65697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:11.055682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b74a40-e9a1-490e-9ce2-826c8cf65697 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:11.074264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1060/2141] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:11.074472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:11.082268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83f8c-120b-409c-b6a6-fb2b76a9d0d8 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:11.087635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:11.088938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:11.089430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:11.090235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] PATH_INFO: `/v3/projects/0d9500bcf60a43ac9dbaf25424b8f24a/users/d8e6521921b842af8ff18b66d0af10d5/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:11.096103 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9500bcf60a43ac9dbaf25424b8f24a, user_id=d8e6521921b842af8ff18b66d0af10d5, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:11.100525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:11.124685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1082/2142] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:11 2022] PUT /identity/v3/projects/0d9500bcf60a43ac9dbaf25424b8f24a/users/d8e6521921b842af8ff18b66d0af10d5/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:11.126229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:11.126615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:11.126991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:11.157658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] MFA Rules not processed for user `d8e6521921b842af8ff18b66d0af10d5`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:11.159026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:11.285779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1061/2143] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:11.312005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:11.318671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:11.397124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a85d7-6bc9-421a-a285-d84702b1e87f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:11.403070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:11.403719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:11.404057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:11.404388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:11.415110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:11.417136 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:11.427306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1083/2144] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:11.768753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:11.770461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:11.785731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879ff0-ecea-42f9-ba9a-fc84a98d1161 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:11.794137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a68bb9-46ad-4835-a5cd-405ec77b96ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:11.794137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68bb9-46ad-4835-a5cd-405ec77b96ef service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:11.794137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68bb9-46ad-4835-a5cd-405ec77b96ef service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:11.794137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a68bb9-46ad-4835-a5cd-405ec77b96ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:11.857329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a68bb9-46ad-4835-a5cd-405ec77b96ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:11.864639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a68bb9-46ad-4835-a5cd-405ec77b96ef service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:11.868827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1062/2145] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:12.682621 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:12.755189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c3159-3fbb-4040-94f3-a54313581710 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:12.760097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:12.760814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:12.761102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:12.761383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] PATH_INFO: `/v3/users/59cd0f2eb737469db410929fe8530a3c` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:12.762722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59cd0f2eb737469db410929fe8530a3c)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:12.764776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:12.950269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:12.950879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:12.950879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:12.972192 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:12.973571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:13.032522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1063/2146] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:00:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:13.076333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:13.077829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:13.134139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59cd0f2eb737469db410929fe8530a3c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:13.135379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59cd0f2eb737469db410929fe8530a3c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:13.136478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59cd0f2eb737469db410929fe8530a3c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:13.148634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59cd0f2eb737469db410929fe8530a3c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:13.169267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ea957-97b3-4fde-b1e5-9bcedf482327 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:13.170853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59cd0f2eb737469db410929fe8530a3c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:13.178415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45827d-6bf0-4240-96b1-40d2e46a5568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:13.179230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45827d-6bf0-4240-96b1-40d2e46a5568 service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:13.179611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45827d-6bf0-4240-96b1-40d2e46a5568 service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:13.179995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45827d-6bf0-4240-96b1-40d2e46a5568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:13.182401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2e45827d-6bf0-4240-96b1-40d2e46a5568 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:13.198605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45827d-6bf0-4240-96b1-40d2e46a5568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:13.201370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45827d-6bf0-4240-96b1-40d2e46a5568 service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:13.216241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1064/2147] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:00:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:00:13.288906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1084/2148] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:12 2022] DELETE /identity/v3/users/59cd0f2eb737469db410929fe8530a3c => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:00:13.294446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:13.294975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:13.295707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:13.318466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:13.320912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:13.398950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1065/2149] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:13.407935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:13.410187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:13.524016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5fdcf-f71d-4937-bf0d-df6eb95a683e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:13.540963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:13.547044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:13.547044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:13.547044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:13.556823 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:13.558883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:13.576188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1085/2150] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:14.899777 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:14.902216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:14.948554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d33ad-da83-4d81-9eec-d287524072a1 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:14.954868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:14.966341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:14.966729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:14.966923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] PATH_INFO: `/v3/projects/276fb2c40d7a48b78fa6179fa674e49b` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:14.968873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=276fb2c40d7a48b78fa6179fa674e49b)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:14.971014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:15.094030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:15.167265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276fb2c40d7a48b78fa6179fa674e49b', 'request_id': 'req-b5c525c6-0c39-429d-b646-284b185d7fad'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.184963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276fb2c40d7a48b78fa6179fa674e49b', 'request_id': 'req-b5c525c6-0c39-429d-b646-284b185d7fad'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.326156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276fb2c40d7a48b78fa6179fa674e49b', 'request_id': 'req-b5c525c6-0c39-429d-b646-284b185d7fad'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.346378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] The token cache is being invalidate because project 276fb2c40d7a48b78fa6179fa674e49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:15.346902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.347751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.350658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1066/2151] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:14 2022] DELETE /identity/v3/projects/276fb2c40d7a48b78fa6179fa674e49b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:15.354656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:15.377050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7395-c5b1-4b82-bae7-38d000914eb2 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:15.450356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:15.451061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:15.451492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:15.451866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] PATH_INFO: `/v3/users/d8e6521921b842af8ff18b66d0af10d5` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:15.453148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e6521921b842af8ff18b66d0af10d5)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:15.455323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:15.879069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:15.924813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e6521921b842af8ff18b66d0af10d5'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.928209 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e6521921b842af8ff18b66d0af10d5'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.929943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e6521921b842af8ff18b66d0af10d5'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.943448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e6521921b842af8ff18b66d0af10d5'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:15.959509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e6521921b842af8ff18b66d0af10d5'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:16.053455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1086/2152] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:15 2022] DELETE /identity/v3/users/d8e6521921b842af8ff18b66d0af10d5 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:16.153792 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:16.156857 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:16.180450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c525c6-0c39-429d-b646-284b185d7fad admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:16.340383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:16.341055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:16.341347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:16.341659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] PATH_INFO: `/v3/users/cb3b634248fb4e968d07d6db6280ad65` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:16.348390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3b634248fb4e968d07d6db6280ad65)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:16.354881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:16.935794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:16.937780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:16.953055 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755682e-7057-455b-bb17-132daa6304d5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:16.958568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:16.959455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:16.959745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:16.960027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] PATH_INFO: `/v3/users/1ef2232e2ff44fb8a611fae0e526a41e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:16.961316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef2232e2ff44fb8a611fae0e526a41e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:16.963473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:16.964927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3b634248fb4e968d07d6db6280ad65'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:16.971948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3b634248fb4e968d07d6db6280ad65'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.183364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3b634248fb4e968d07d6db6280ad65'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.185483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3b634248fb4e968d07d6db6280ad65'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.203152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3b634248fb4e968d07d6db6280ad65'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.209554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1067/2153] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:16 2022] DELETE /identity/v3/users/cb3b634248fb4e968d07d6db6280ad65 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:17.210943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:17.212893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.315285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef2232e2ff44fb8a611fae0e526a41e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.316470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef2232e2ff44fb8a611fae0e526a41e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.317154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef2232e2ff44fb8a611fae0e526a41e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.326470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a942b2-6d0a-4e93-ac43-21ea13a0214b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:17.326733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef2232e2ff44fb8a611fae0e526a41e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.332955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:17.334015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.334482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.334768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] PATH_INFO: `/v3/projects/0d9500bcf60a43ac9dbaf25424b8f24a` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.335976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9500bcf60a43ac9dbaf25424b8f24a)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:17.338016 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:17.342006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ae9ee34f-13c0-4656-8027-76ae268fc84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef2232e2ff44fb8a611fae0e526a41e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.495398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1087/2154] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:16 2022] DELETE /identity/v3/users/1ef2232e2ff44fb8a611fae0e526a41e => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:00:17.497582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad17bc-cd5d-4780-8f0a-fcd19fcd4b57 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.498049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad17bc-cd5d-4780-8f0a-fcd19fcd4b57 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.499140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad17bc-cd5d-4780-8f0a-fcd19fcd4b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.534982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9500bcf60a43ac9dbaf25424b8f24a', 'request_id': 'req-061de464-81f3-4566-812b-7bc2d7ec9525'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.544954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9500bcf60a43ac9dbaf25424b8f24a', 'request_id': 'req-061de464-81f3-4566-812b-7bc2d7ec9525'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.545731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-77ad17bc-cd5d-4780-8f0a-fcd19fcd4b57 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:17.548006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-77ad17bc-cd5d-4780-8f0a-fcd19fcd4b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.621304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1088/2155] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:17.622903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.623251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.623493 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.644206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:17.645468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.654388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1089/2156] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:17.657671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:17.658534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.672183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9500bcf60a43ac9dbaf25424b8f24a', 'request_id': 'req-061de464-81f3-4566-812b-7bc2d7ec9525'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.686432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] The token cache is being invalidate because project 0d9500bcf60a43ac9dbaf25424b8f24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:17.686987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.687828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:17.689932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1068/2157] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:17 2022] DELETE /identity/v3/projects/0d9500bcf60a43ac9dbaf25424b8f24a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:17.695439 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:17.697129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.768739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de464-81f3-4566-812b-7bc2d7ec9525 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:17.775814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01049ecb-c112-4983-bdb4-bfe46859a512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:17.775814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01049ecb-c112-4983-bdb4-bfe46859a512 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.775814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01049ecb-c112-4983-bdb4-bfe46859a512 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.775814 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01049ecb-c112-4983-bdb4-bfe46859a512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.777382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-01049ecb-c112-4983-bdb4-bfe46859a512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.789838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12998b2c-f9f3-4eda-a1ee-4368fd68f1db None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:17.793463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01049ecb-c112-4983-bdb4-bfe46859a512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:17.796221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01049ecb-c112-4983-bdb4-bfe46859a512 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:17.804315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3342a-e9ce-473b-b383-055eeed6afbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:17.805159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3342a-e9ce-473b-b383-055eeed6afbc service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.805451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3342a-e9ce-473b-b383-055eeed6afbc service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.805917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3342a-e9ce-473b-b383-055eeed6afbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.811786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-95f3342a-e9ce-473b-b383-055eeed6afbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.825510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1069/2158] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:17.829405 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485085-df4d-4a6f-9cb3-0092e47d619e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.829738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485085-df4d-4a6f-9cb3-0092e47d619e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.830022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485085-df4d-4a6f-9cb3-0092e47d619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.844464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3342a-e9ce-473b-b383-055eeed6afbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:17.844464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3342a-e9ce-473b-b383-055eeed6afbc service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:17.860786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1090/2159] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:17.863601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-64485085-df4d-4a6f-9cb3-0092e47d619e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:17.864824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-64485085-df4d-4a6f-9cb3-0092e47d619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.876363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1070/2160] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:17.884806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b176-5deb-4617-b05e-e8a0d4d5dfbb None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.885107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b176-5deb-4617-b05e-e8a0d4d5dfbb None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.885564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b176-5deb-4617-b05e-e8a0d4d5dfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.917630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5632b176-5deb-4617-b05e-e8a0d4d5dfbb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:17.919172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5632b176-5deb-4617-b05e-e8a0d4d5dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:17.936892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1091/2161] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:17.939820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485085-df4d-4a6f-9cb3-0092e47d619e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:17.955546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485085-df4d-4a6f-9cb3-0092e47d619e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:17.962456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:17.963231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:17.963612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:17.963983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:17.964819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:00:17.965251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:17.967060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:17.995112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1071/2162] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:00:18.005589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b176-5deb-4617-b05e-e8a0d4d5dfbb None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:18.020098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b176-5deb-4617-b05e-e8a0d4d5dfbb None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:18.028107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:18.029048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:18.029594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:18.030042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:18.031054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:18.033802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:18.188023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1092/2163] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:18 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:18.193612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:18.215471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84325401-6835-41aa-b489-4df4ffaa6135 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:18.353257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:18.354167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:18.354703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:18.355210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:18.356118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:18.358735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:18.470216 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1072/2164] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:18 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:18.474107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:18.484920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29407718-c0f5-4546-bcfb-5071e0ecf98a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:18.493486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:18.494158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:18.494443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:18.494717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:18.495423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:18.497056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:18.509148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1093/2165] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:18.514340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:18.529399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5976-f960-4767-8e54-7a674c7ae052 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:18.535962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609549f4-26e9-4920-bed7-6d66d044ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:18.536964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609549f4-26e9-4920-bed7-6d66d044ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:18.537488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609549f4-26e9-4920-bed7-6d66d044ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:18.538018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609549f4-26e9-4920-bed7-6d66d044ab14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:18.539890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609549f4-26e9-4920-bed7-6d66d044ab14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:18.542344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609549f4-26e9-4920-bed7-6d66d044ab14 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:18.563745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1073/2166] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:18.570452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:18.584745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ffec2-4242-4430-bb01-b4e64f992f71 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:18.597395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:18.607615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:18.607615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:18.607615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] PATH_INFO: `/v3/projects/08dcec660d76441783c0bea208ef40c1/users/022b7d9a04ee4064bfb6298d4c37fa89/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:18.619382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dcec660d76441783c0bea208ef40c1, user_id=022b7d9a04ee4064bfb6298d4c37fa89, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:18.623229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:18.745854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1094/2167] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:18 2022] PUT /identity/v3/projects/08dcec660d76441783c0bea208ef40c1/users/022b7d9a04ee4064bfb6298d4c37fa89/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:00:18.760393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:18.764046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:18.764046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:18.796308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] MFA Rules not processed for user `022b7d9a04ee4064bfb6298d4c37fa89`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:18.798213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:18.805726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:18.895784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1074/2168] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:18.916727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:18.917626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:18.920765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:18.920888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:19.009686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:19.041623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569154-30ea-4ded-9937-04981b167e3c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:19.046181 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:19.050884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:19.050884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:19.050884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:19.057726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:19.059443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:19.063459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c35248-88fb-4e23-8953-7a741b6999d8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:19.070121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:19.070683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1095/2169] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:19.071650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:19.073117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:19.080443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:19.080740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:19.082062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] PATH_INFO: `/v3/projects/add6cf8683774b4793737918c31be0aa` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:19.085167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=add6cf8683774b4793737918c31be0aa)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:19.089107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5020-b187-4500-877b-24e20fc48c4a service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:19.090376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:19.098486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:19.099161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:19.099634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:19.100082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] PATH_INFO: `/v3/projects/39510d76b9c0464e9ead0ea78db5a0cc` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:19.101636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39510d76b9c0464e9ead0ea78db5a0cc)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:19.103807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:19.243671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add6cf8683774b4793737918c31be0aa', 'request_id': 'req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.251136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add6cf8683774b4793737918c31be0aa', 'request_id': 'req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.280128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39510d76b9c0464e9ead0ea78db5a0cc', 'request_id': 'req-a44f94dc-891a-4868-a003-01f760155b6b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.290221 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39510d76b9c0464e9ead0ea78db5a0cc', 'request_id': 'req-a44f94dc-891a-4868-a003-01f760155b6b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.359552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add6cf8683774b4793737918c31be0aa', 'request_id': 'req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.386784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] The token cache is being invalidate because project add6cf8683774b4793737918c31be0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:19.388348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.392198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.397758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1075/2170] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:18 2022] DELETE /identity/v3/projects/add6cf8683774b4793737918c31be0aa => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:19.401752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:19.409833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:19.457163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39510d76b9c0464e9ead0ea78db5a0cc', 'request_id': 'req-a44f94dc-891a-4868-a003-01f760155b6b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.476164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] The token cache is being invalidate because project 39510d76b9c0464e9ead0ea78db5a0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:19.476548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.478759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.483747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1096/2171] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:19 2022] DELETE /identity/v3/projects/39510d76b9c0464e9ead0ea78db5a0cc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:19.484765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:19.488941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:19.549768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1eeef1-3d51-4531-a0b3-f3e6da8bdd42 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:19.654338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f94dc-891a-4868-a003-01f760155b6b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:19.667199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:19.667903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:19.668284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:19.668468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] PATH_INFO: `/v3/users/eca48d2e7ce446f3bd6a243f905ee809` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:19.671330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca48d2e7ce446f3bd6a243f905ee809)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:19.675050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:19.679609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:19.680447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:19.680890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:19.681338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] PATH_INFO: `/v3/users/022b7d9a04ee4064bfb6298d4c37fa89` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:19.682800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=022b7d9a04ee4064bfb6298d4c37fa89)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:19.686251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:19.813175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:19.871773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca48d2e7ce446f3bd6a243f905ee809'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.872868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca48d2e7ce446f3bd6a243f905ee809'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.873571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca48d2e7ce446f3bd6a243f905ee809'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.883946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca48d2e7ce446f3bd6a243f905ee809'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.931511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-15e9037a-9f1c-4c19-9525-dcd9e14e5cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca48d2e7ce446f3bd6a243f905ee809'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.963474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022b7d9a04ee4064bfb6298d4c37fa89'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:19.972265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022b7d9a04ee4064bfb6298d4c37fa89'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:20.147771 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1097/2172] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:19 2022] DELETE /identity/v3/users/eca48d2e7ce446f3bd6a243f905ee809 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:20.162088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74e87-4b5c-4f12-882d-47dcb053e378 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.162088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74e87-4b5c-4f12-882d-47dcb053e378 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.162088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74e87-4b5c-4f12-882d-47dcb053e378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.201877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a1e74e87-4b5c-4f12-882d-47dcb053e378 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:20.203497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a1e74e87-4b5c-4f12-882d-47dcb053e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:20.295663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022b7d9a04ee4064bfb6298d4c37fa89'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:20.295663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022b7d9a04ee4064bfb6298d4c37fa89'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:20.299536 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1098/2173] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:20.309577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b893029-6780-4da0-b690-f5d717bcae4f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.309577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b893029-6780-4da0-b690-f5d717bcae4f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.309577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b893029-6780-4da0-b690-f5d717bcae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.328316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0dbd280d-983d-4794-9340-e0278d41a86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022b7d9a04ee4064bfb6298d4c37fa89'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:20.349415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1076/2174] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:19 2022] DELETE /identity/v3/users/022b7d9a04ee4064bfb6298d4c37fa89 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:20.350256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7b893029-6780-4da0-b690-f5d717bcae4f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:20.351498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7b893029-6780-4da0-b690-f5d717bcae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:20.365943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.366241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.366509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.393136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:20.394347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:20.430855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1099/2175] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:20.435944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b893029-6780-4da0-b690-f5d717bcae4f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:20.444894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b893029-6780-4da0-b690-f5d717bcae4f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:20.452260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:20.452485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.452628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.452870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.453616 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:00:20.453929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:20.455544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:20.458203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1077/2176] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:20.468107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1100/2177] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:00:20.468517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:20.470079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:20.472723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:20.483050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38c362-3857-4f4a-acaa-a91092f0e7a3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:20.488409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:20.489025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.489313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.489628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.490522 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:20.492400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:20.530414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bcb2-3fca-430b-bb74-0a4522ed1932 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:20.534558 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:20.535253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.535533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.535808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.550708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:20.550708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:20.562065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1078/2178] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:20.697166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1101/2179] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:20 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:20.698946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:20.718436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c5ce0-9b54-41f9-97c1-4cf1d9b37d44 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:20.800804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:20.802869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:20.831849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:20.833595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.833595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.833595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.834254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:20.836575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:20.935961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b288d56-94d3-4d6e-82cd-17e3a33c8769 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:20.954074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:20.954074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:20.954074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:20.954446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1079/2180] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:20 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:20.954546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] PATH_INFO: `/v3/projects/d219c1bb68994d9db1c37b108cfaf9f7` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:20.954638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:20.954730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d219c1bb68994d9db1c37b108cfaf9f7)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:20.954730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:20.979386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04c80f-e059-4e9a-8bbd-08ca1634de8b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:20.989422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:21.007215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:21.010747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:21.011262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:21.013033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:21.016368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:21.020526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:21.039061 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1080/2181] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:00:21.043932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:21.056993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaa7d3-7586-4d7e-afad-0d57268704ff admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:21.062256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:21.063121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:21.063344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:21.063432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:21.064165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:21.067119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:21.101862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1081/2182] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:21.103223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:21.118581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a35b-f80a-4f8d-a333-04fb07d50881 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:21.138658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:21.139576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:21.140000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:21.140397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] PATH_INFO: `/v3/projects/23649fb47259424cbe4512fb48485955/users/cdd3c6ab46184c86b2b8f9c436e5d488/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:21.164257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23649fb47259424cbe4512fb48485955, user_id=cdd3c6ab46184c86b2b8f9c436e5d488, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:21.167808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:21.178984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd219c1bb68994d9db1c37b108cfaf9f7', 'request_id': 'req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.186712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd219c1bb68994d9db1c37b108cfaf9f7', 'request_id': 'req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.333175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1082/2183] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:21 2022] PUT /identity/v3/projects/23649fb47259424cbe4512fb48485955/users/cdd3c6ab46184c86b2b8f9c436e5d488/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:21.335630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:21.337776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:21.358431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd219c1bb68994d9db1c37b108cfaf9f7', 'request_id': 'req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.392801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] The token cache is being invalidate because project d219c1bb68994d9db1c37b108cfaf9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:21.393589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.397293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e67c4d5b-24a5-4f06-9169-5a6ff561c0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.403315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1102/2184] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:20 2022] DELETE /identity/v3/projects/d219c1bb68994d9db1c37b108cfaf9f7 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:21.405212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:21.405945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:21.416344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:21.455534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ceb51-14de-4498-8d48-32c9e2d23ce5 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:21.456902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] MFA Rules not processed for user `cdd3c6ab46184c86b2b8f9c436e5d488`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:21.458843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:21.465349 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:21.466184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:21.466573 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:21.467219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] PATH_INFO: `/v3/projects/08dcec660d76441783c0bea208ef40c1` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:21.469076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08dcec660d76441783c0bea208ef40c1)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:21.471190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:21.551778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1103/2185] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:21.554508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:21.561316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:21.584720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a4f8-8f83-4b91-ab10-e91cbfe7d104 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:21.602248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:21.603225 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:21.604821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:21.605299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] PATH_INFO: `/v3/users/42aac783723547e2b665ac782343c2ec` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:21.607089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42aac783723547e2b665ac782343c2ec)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:21.609282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:21.618140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08dcec660d76441783c0bea208ef40c1', 'request_id': 'req-b2035571-8b22-4a79-80ef-7eec831d0422'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.628985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08dcec660d76441783c0bea208ef40c1', 'request_id': 'req-b2035571-8b22-4a79-80ef-7eec831d0422'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.731480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08dcec660d76441783c0bea208ef40c1', 'request_id': 'req-b2035571-8b22-4a79-80ef-7eec831d0422'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.745782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] The token cache is being invalidate because project 08dcec660d76441783c0bea208ef40c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:21.746151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.747540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.753110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1083/2186] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:21 2022] DELETE /identity/v3/projects/08dcec660d76441783c0bea208ef40c1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:21.754990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:21.759960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:21.857273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035571-8b22-4a79-80ef-7eec831d0422 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:21.864933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c323770-9c1e-4c57-b0a2-82e33fcee617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:21.864933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323770-9c1e-4c57-b0a2-82e33fcee617 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:21.864933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323770-9c1e-4c57-b0a2-82e33fcee617 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:21.865269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323770-9c1e-4c57-b0a2-82e33fcee617 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:21.866851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323770-9c1e-4c57-b0a2-82e33fcee617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:21.868813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323770-9c1e-4c57-b0a2-82e33fcee617 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:21.919733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42aac783723547e2b665ac782343c2ec'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.920909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42aac783723547e2b665ac782343c2ec'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.921898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42aac783723547e2b665ac782343c2ec'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.959163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42aac783723547e2b665ac782343c2ec'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:21.978561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42aac783723547e2b665ac782343c2ec'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:22.008094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1084/2187] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:21 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:22.009482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a6a1-39e8-46ff-a63e-92103bbe7013 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.009966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a6a1-39e8-46ff-a63e-92103bbe7013 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.010225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a6a1-39e8-46ff-a63e-92103bbe7013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.035741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-32d3a6a1-39e8-46ff-a63e-92103bbe7013 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:22.037465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-32d3a6a1-39e8-46ff-a63e-92103bbe7013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:22.096109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1104/2188] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:21 2022] DELETE /identity/v3/users/42aac783723547e2b665ac782343c2ec => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:22.099861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.099861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:22.163786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1085/2189] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:22.175589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e18ae0-e9f8-4ba5-b161-262b472bd492 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.176017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e18ae0-e9f8-4ba5-b161-262b472bd492 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.176491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e18ae0-e9f8-4ba5-b161-262b472bd492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.198059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9a15-8faa-4a66-9ac0-bf16e00fd5d5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.213407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.214408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.214967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.215431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.216284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.218439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.225014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-95e18ae0-e9f8-4ba5-b161-262b472bd492 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:22.226582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-95e18ae0-e9f8-4ba5-b161-262b472bd492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:22.250983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1086/2190] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:22.252393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e18ae0-e9f8-4ba5-b161-262b472bd492 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.266203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e18ae0-e9f8-4ba5-b161-262b472bd492 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.281362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.282090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.282379 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.283462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.283462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:00:22.283791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.290093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.326150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1087/2191] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:00:22.332650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.342314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1105/2192] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:22 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:22.350010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.353876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf9fc5-c20c-416e-921e-66490e8f2979 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.363539 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.364622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.364908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.365188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.366035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.369790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.370139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:22.380998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076a104-d9ae-41ce-8206-8929be01f574 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.398756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.399490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.399779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.400097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.400797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.404081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.428876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1106/2193] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:22.432638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.450913 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb5eb-fac0-487b-99ee-9febedc85d90 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.457828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.466492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.466492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.466492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.466492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.466492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.487189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1107/2194] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:22.491608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.503991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798725bb-52b8-4478-84cf-1c13e43ea0c6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.511127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e691c-4c4d-4c92-8609-32de5194511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.511919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e691c-4c4d-4c92-8609-32de5194511f admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.512216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e691c-4c4d-4c92-8609-32de5194511f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.512540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e691c-4c4d-4c92-8609-32de5194511f admin admin] PATH_INFO: `/v3/projects/6180b2e2a29644bc824ad1c686e65fd0/users/e4cfa075ce13434f9a912dacf2da54b2/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.538822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e691c-4c4d-4c92-8609-32de5194511f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6180b2e2a29644bc824ad1c686e65fd0, user_id=e4cfa075ce13434f9a912dacf2da54b2, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.541792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e691c-4c4d-4c92-8609-32de5194511f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.595185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1088/2195] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:22 2022] POST /identity/v3/projects => generated 357 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:22.599236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.690186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7e87b-67c5-4233-b7e3-c1fe01978d8f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.696819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.697455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.697779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.698125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.698874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.700800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.742166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1108/2196] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:22 2022] PUT /identity/v3/projects/6180b2e2a29644bc824ad1c686e65fd0/users/e4cfa075ce13434f9a912dacf2da54b2/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:22.804745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0eefa-4fcf-4c27-a56a-1601aa89b501 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.805044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0eefa-4fcf-4c27-a56a-1601aa89b501 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.805327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0eefa-4fcf-4c27-a56a-1601aa89b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.828228 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1089/2197] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:22 2022] POST /identity/v3/users => generated 279 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:22.835140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.835140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:22.859174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab56a9f-8f1d-4a40-8ab7-b4a8ebbb7873 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.866419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5fd0eefa-4fcf-4c27-a56a-1601aa89b501 None None] MFA Rules not processed for user `e4cfa075ce13434f9a912dacf2da54b2`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:22.867688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5fd0eefa-4fcf-4c27-a56a-1601aa89b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:22.938781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.939609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.941109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.941109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] PATH_INFO: `/v3/projects/87d54dd16f8544d58d62f440427dd4b9` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.941754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d54dd16f8544d58d62f440427dd4b9)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:22.943965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:22.972601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1109/2198] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:22.973735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0eefa-4fcf-4c27-a56a-1601aa89b501 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:22.987552 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0eefa-4fcf-4c27-a56a-1601aa89b501 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:22.996633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:22.997373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:22.997782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:22.998206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:22.999039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.001104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.017564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1110/2199] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:23.017564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.032611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061de06-561c-469d-9cab-fbe6651992b4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.040550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.041438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.042027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.042557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.043475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.045642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.131855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d54dd16f8544d58d62f440427dd4b9', 'request_id': 'req-3c5fdabc-8938-4c41-890d-bc4571cc68f2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:23.138553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d54dd16f8544d58d62f440427dd4b9', 'request_id': 'req-3c5fdabc-8938-4c41-890d-bc4571cc68f2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:23.156515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1111/2200] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:23 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:23.157399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.228727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d54dd16f8544d58d62f440427dd4b9', 'request_id': 'req-3c5fdabc-8938-4c41-890d-bc4571cc68f2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:23.246002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94df40-d5ef-4ba8-9f9b-138828c4dad1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.246526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] The token cache is being invalidate because project 87d54dd16f8544d58d62f440427dd4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:23.246526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:23.247199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:23.252283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1090/2201] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:22 2022] DELETE /identity/v3/projects/87d54dd16f8544d58d62f440427dd4b9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:23.252283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.252283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:23.257241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e871f1d-502f-4221-ab31-bfb5b57cc979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.258840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e871f1d-502f-4221-ab31-bfb5b57cc979 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.259310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e871f1d-502f-4221-ab31-bfb5b57cc979 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.259780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e871f1d-502f-4221-ab31-bfb5b57cc979 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.260731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e871f1d-502f-4221-ab31-bfb5b57cc979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.262820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e871f1d-502f-4221-ab31-bfb5b57cc979 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.284284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1112/2202] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:23.286182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.286699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.287194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.315073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:23.316962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:23.327205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1113/2203] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:23.328250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.335865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:23.349840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fdabc-8938-4c41-890d-bc4571cc68f2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.350234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638d109-902b-4b81-a30a-62162ab48488 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.355324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda892-5490-4802-837a-2a922a69e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.356486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda892-5490-4802-837a-2a922a69e1bc admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.356934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda892-5490-4802-837a-2a922a69e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.357487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda892-5490-4802-837a-2a922a69e1bc admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.358425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda892-5490-4802-837a-2a922a69e1bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.360378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda892-5490-4802-837a-2a922a69e1bc admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.361465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.362668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.363739 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.364037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] PATH_INFO: `/v3/projects/4abb385d1f344b96a2b4876d0ba67edb/users/1c768160749e4471a7976e783dd7cf2b/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.397713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abb385d1f344b96a2b4876d0ba67edb, user_id=1c768160749e4471a7976e783dd7cf2b, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.404271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.441017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:23.495599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1091/2204] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:23 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:23.497306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299de661-e56e-4f98-9aa4-2292ee2b1b9b None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.499734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299de661-e56e-4f98-9aa4-2292ee2b1b9b None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.500219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299de661-e56e-4f98-9aa4-2292ee2b1b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.516766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1114/2205] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:23 2022] PUT /identity/v3/projects/4abb385d1f344b96a2b4876d0ba67edb/users/1c768160749e4471a7976e783dd7cf2b/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:23.518185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.546679 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-299de661-e56e-4f98-9aa4-2292ee2b1b9b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:23.548304 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-299de661-e56e-4f98-9aa4-2292ee2b1b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:23.604872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cfb2-9e26-42a5-9574-76b0c32a9a25 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.610585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd385b6-1fa9-4723-aa27-fa01ecb0029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.611480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd385b6-1fa9-4723-aa27-fa01ecb0029a admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.611818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd385b6-1fa9-4723-aa27-fa01ecb0029a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.612636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd385b6-1fa9-4723-aa27-fa01ecb0029a admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.613457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd385b6-1fa9-4723-aa27-fa01ecb0029a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.616008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd385b6-1fa9-4723-aa27-fa01ecb0029a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.630527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1115/2206] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:23.630527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e63c-a122-4200-9c29-0cdf388273ea None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.630902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e63c-a122-4200-9c29-0cdf388273ea None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.631106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e63c-a122-4200-9c29-0cdf388273ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.639468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1092/2207] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:23.640640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299de661-e56e-4f98-9aa4-2292ee2b1b9b None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.655468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299de661-e56e-4f98-9aa4-2292ee2b1b9b None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.661651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.662674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.663218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.663713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] PATH_INFO: `/v3/projects/de7b9bd90eac420281efeeced7596abe/users/649a765e2c4b441998a613d4225f702d/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.666138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9ad0e63c-a122-4200-9c29-0cdf388273ea None None] MFA Rules not processed for user `1c768160749e4471a7976e783dd7cf2b`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:23.668204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9ad0e63c-a122-4200-9c29-0cdf388273ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:23.697390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7b9bd90eac420281efeeced7596abe, user_id=649a765e2c4b441998a613d4225f702d, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.700861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.802882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1093/2208] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:23 2022] PUT /identity/v3/projects/de7b9bd90eac420281efeeced7596abe/users/649a765e2c4b441998a613d4225f702d/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:23.803909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.813285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1116/2209] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:23.814466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e63c-a122-4200-9c29-0cdf388273ea None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.828559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e63c-a122-4200-9c29-0cdf388273ea None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.932078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea6820-406f-43cb-b1ec-617af4ea6a61 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.938150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.939013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.949259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.949259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.949259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:00:23.949631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.949742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.949827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.949827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.949827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.950154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.950228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:23.950228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:23.960642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1094/2210] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:00:23.961752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.963601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:23.969776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1117/2211] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:23.971167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:23.985286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae37b92-60f8-4c43-a6fe-21fa1dc611c5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:23.991816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:23.993081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:23.993745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:23.994704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:23.995620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.001180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.063477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131696-64ff-4cf7-a237-a7d907231d3e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.068582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.069408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.069726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.070088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.108018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1118/2212] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:23 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:24.109023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:24.148165 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.150250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.170678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1095/2213] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:24.170678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:24.188279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090571e-307e-4f5c-be69-c3a7df625821 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.225641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e74ac0-c845-4a16-adde-4ee6a27ccaa1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.239224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.240395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.240395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.240654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] PATH_INFO: `/v3/projects/de7b9bd90eac420281efeeced7596abe/users/649a765e2c4b441998a613d4225f702d/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.244959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7b9bd90eac420281efeeced7596abe, user_id=649a765e2c4b441998a613d4225f702d, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.247812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.269370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1119/2214] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:24 2022] PUT /identity/v3/projects/de7b9bd90eac420281efeeced7596abe/users/649a765e2c4b441998a613d4225f702d/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:24.270425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:24.325313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e59f6-4a3a-4e24-975b-307bea2e9115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.326017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e59f6-4a3a-4e24-975b-307bea2e9115 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.326565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e59f6-4a3a-4e24-975b-307bea2e9115 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.326917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e59f6-4a3a-4e24-975b-307bea2e9115 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.327806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e59f6-4a3a-4e24-975b-307bea2e9115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.329926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e59f6-4a3a-4e24-975b-307bea2e9115 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.372412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa4eb4-2a21-4399-a84b-21d732175c89 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.384207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.385897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.385897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.385897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] PATH_INFO: `/v3/users/1c768160749e4471a7976e783dd7cf2b` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.386825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c768160749e4471a7976e783dd7cf2b)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.388797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.483470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1096/2215] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:24 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:24.486175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ed552-3344-48f6-871d-7a72f5f3f6d5 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.486560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ed552-3344-48f6-871d-7a72f5f3f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.486927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ed552-3344-48f6-871d-7a72f5f3f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.526853 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-204ed552-3344-48f6-871d-7a72f5f3f6d5 None None] MFA Rules not processed for user `649a765e2c4b441998a613d4225f702d`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:24.528530 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-204ed552-3344-48f6-871d-7a72f5f3f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:24.600896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1097/2216] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:24.601705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ed552-3344-48f6-871d-7a72f5f3f6d5 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:24.611925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ed552-3344-48f6-871d-7a72f5f3f6d5 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.616670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.627781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.627781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.627781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.627781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.627781 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.630584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1098/2217] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:24.631369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:24.632988 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:24.647134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:24.705288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d08f00-eba8-4c32-bbfe-2eaa5e4898a2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.709591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.710173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.710462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.710746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.712546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:24.764912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:24.808930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.811715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.822101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c768160749e4471a7976e783dd7cf2b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:24.824824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c768160749e4471a7976e783dd7cf2b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:24.827549 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c768160749e4471a7976e783dd7cf2b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:24.831946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1099/2218] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:24.833766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:24.847056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4e64-a608-45a3-bda7-b91e0e75ec4b service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.853038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.853731 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.854084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.854549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.855418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.857265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:24.865185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c768160749e4471a7976e783dd7cf2b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:24.872227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1100/2219] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:24.878747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:24.881668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:24.909702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ba5dd198-41fc-44cb-952e-d8dca60f90f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c768160749e4471a7976e783dd7cf2b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:24.914601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466750ba-9174-4ee4-ab0b-cab07bde9379 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:24.921099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2e138-4107-4229-81e7-5fc06b58c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:24.922008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e138-4107-4229-81e7-5fc06b58c9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:24.922407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e138-4107-4229-81e7-5fc06b58c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:24.922754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e138-4107-4229-81e7-5fc06b58c9a6 admin admin] PATH_INFO: `/v3/projects/254ab80a5e964623871b5ae8c68b122d/users/b4733821a5e4408ba020cabeae832562/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:24.944161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2e138-4107-4229-81e7-5fc06b58c9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254ab80a5e964623871b5ae8c68b122d, user_id=b4733821a5e4408ba020cabeae832562, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:24.956868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2e138-4107-4229-81e7-5fc06b58c9a6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:25.041015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1120/2220] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:24 2022] DELETE /identity/v3/users/1c768160749e4471a7976e783dd7cf2b => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:25.045940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:25.046498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:25.046945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:25.086182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:25.087774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:25.136597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1101/2221] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:24 2022] PUT /identity/v3/projects/254ab80a5e964623871b5ae8c68b122d/users/b4733821a5e4408ba020cabeae832562/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:25.153362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:25.153362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:25.153807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:25.189601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] MFA Rules not processed for user `b4733821a5e4408ba020cabeae832562`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:25.193119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:25.213570 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1121/2222] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:00:25.222880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:25.225056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:25.331802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184217a-60cb-4ba9-a285-d3ad7e981924 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:25.364128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1102/2223] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:25.381774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:25.387090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:25.400461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:25.401128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:25.401423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:25.401736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:25.472796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:25.474381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:25.487686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1122/2224] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:00:25.515217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ade794-e25b-4fea-8eda-f1227069a5cf None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:25.521571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24921631-e959-4441-a862-6322547f0731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:25.522218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24921631-e959-4441-a862-6322547f0731 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:25.522587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24921631-e959-4441-a862-6322547f0731 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:25.523340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24921631-e959-4441-a862-6322547f0731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:25.536506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24921631-e959-4441-a862-6322547f0731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:25.538598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24921631-e959-4441-a862-6322547f0731 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:25.550316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1103/2225] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:26.442390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:26.447691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:26.462183 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c7f6d-6162-406c-a8ee-f556fbb747a7 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:26.472816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:26.481318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:26.486901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:26.486901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] PATH_INFO: `/v3/projects/4abb385d1f344b96a2b4876d0ba67edb` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:26.486901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abb385d1f344b96a2b4876d0ba67edb)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:26.486901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:26.704245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abb385d1f344b96a2b4876d0ba67edb', 'request_id': 'req-cc569a59-7e18-409a-8936-1abc1d947d34'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:26.713369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abb385d1f344b96a2b4876d0ba67edb', 'request_id': 'req-cc569a59-7e18-409a-8936-1abc1d947d34'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:26.861625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abb385d1f344b96a2b4876d0ba67edb', 'request_id': 'req-cc569a59-7e18-409a-8936-1abc1d947d34'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:26.862426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:26.893088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] The token cache is being invalidate because project 4abb385d1f344b96a2b4876d0ba67edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:26.898251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:26.899432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-cc569a59-7e18-409a-8936-1abc1d947d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:26.905061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1123/2226] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:26 2022] DELETE /identity/v3/projects/4abb385d1f344b96a2b4876d0ba67edb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:26.907490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468a15-a6fc-4409-9034-fead385ded41 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:26.907778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468a15-a6fc-4409-9034-fead385ded41 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:26.908394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468a15-a6fc-4409-9034-fead385ded41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:26.957754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-69468a15-a6fc-4409-9034-fead385ded41 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:26.960068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-69468a15-a6fc-4409-9034-fead385ded41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:27.056298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1104/2227] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:27.064996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e03a8-465d-4569-a07a-7e8eea55fe1b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.066245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e03a8-465d-4569-a07a-7e8eea55fe1b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.071384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:27.073675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e03a8-465d-4569-a07a-7e8eea55fe1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:27.119750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d65e03a8-465d-4569-a07a-7e8eea55fe1b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:27.121002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d65e03a8-465d-4569-a07a-7e8eea55fe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:27.147808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1124/2228] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:27.148952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69468a15-a6fc-4409-9034-fead385ded41 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:27.163603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69468a15-a6fc-4409-9034-fead385ded41 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:27.184344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:27.185338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.185701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.185979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:27.186797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:00:27.187870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:27.191359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:27.232559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1105/2229] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:00:27.236092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e03a8-465d-4569-a07a-7e8eea55fe1b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:27.248923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e03a8-465d-4569-a07a-7e8eea55fe1b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:27.267535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:27.268184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.269228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.269474 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:27.270081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:27.272051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:27.452335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1125/2230] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:27 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:27.453640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:27.468083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feea902-792f-4f5a-9517-1ec62299025d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:27.526148 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:27.528073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:27.598537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:27.599390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.599736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.600449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:27.601186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:27.609078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:27.632653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3393b-3bb1-4716-809e-5b313216be3c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:27.639894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:27.641188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.641814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.642287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:27.645319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:27.739458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1106/2231] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:27 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:27.744803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:27.765682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68054411-d3e0-4ea5-bba8-ce66a37897d7 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:27.770106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:27.771708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:27.779305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:27.780193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.780193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.780334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:27.781926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:27.786928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:27.810056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1126/2232] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:00:27.819812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:27.820156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1107/2233] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:27.866461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224cc4c-440f-43d5-b91f-af20ebf89f5c service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:27.884274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d441887-8d24-4611-b719-44da96d02462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:27.889001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441887-8d24-4611-b719-44da96d02462 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.889299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441887-8d24-4611-b719-44da96d02462 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.889765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441887-8d24-4611-b719-44da96d02462 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:27.890738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d441887-8d24-4611-b719-44da96d02462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:27.894204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d441887-8d24-4611-b719-44da96d02462 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:27.938017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1127/2234] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:00:27.939364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:27.974240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9332d-a3ec-4b9d-a898-c56c580f1d52 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:27.991129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:27.992092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:27.992828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:27.994130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] PATH_INFO: `/v3/projects/a95d82f4043d47d4ab1a2e01bcda3ca7/users/8aaabcf6ef144ff98e700f2f031ff3b5/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:28.024899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95d82f4043d47d4ab1a2e01bcda3ca7, user_id=8aaabcf6ef144ff98e700f2f031ff3b5, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:28.028822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:28.162076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1108/2235] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:27 2022] PUT /identity/v3/projects/a95d82f4043d47d4ab1a2e01bcda3ca7/users/8aaabcf6ef144ff98e700f2f031ff3b5/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:28.167501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:28.167924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:28.168245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:28.211638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:28.213197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:28.342717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1128/2236] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:28.353545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:28.365002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:28.501004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a47f-6fc9-4a0a-afcb-c34491fe1a4c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:28.505908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:28.507059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:28.507177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:28.507854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:28.519526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:28.521236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:28.533712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1109/2237] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:29.833145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:29.932863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:30.730200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:30.732827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:30.804326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece893a3-7316-49a9-8b5f-da72f3d28ef1 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:30.820310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24dfa2-9f40-4bb5-8eb3-1ebcfaf74d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:30.821460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24dfa2-9f40-4bb5-8eb3-1ebcfaf74d55 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:30.825004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24dfa2-9f40-4bb5-8eb3-1ebcfaf74d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:30.825004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24dfa2-9f40-4bb5-8eb3-1ebcfaf74d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:30.828443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6e24dfa2-9f40-4bb5-8eb3-1ebcfaf74d55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:31.001308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24dfa2-9f40-4bb5-8eb3-1ebcfaf74d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:31.007194 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24dfa2-9f40-4bb5-8eb3-1ebcfaf74d55 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:31.044941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1129/2238] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:31.444449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:31.756305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:31.757964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:31.789211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0850c-5d9e-4da8-99e1-d83196e25b02 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:31.800121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:31.801058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:31.801610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:31.802074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] PATH_INFO: `/v3/users/b4733821a5e4408ba020cabeae832562` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:31.804320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4733821a5e4408ba020cabeae832562)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:31.808154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:32.045248 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4733821a5e4408ba020cabeae832562'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:32.060619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4733821a5e4408ba020cabeae832562'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:32.131877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4733821a5e4408ba020cabeae832562'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:32.134704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:32.135429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4733821a5e4408ba020cabeae832562'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:32.170920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4733821a5e4408ba020cabeae832562'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:32.181186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1110/2239] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:31 2022] DELETE /identity/v3/users/b4733821a5e4408ba020cabeae832562 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:32.187683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:32.188920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:32.189565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:32.235425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:32.238841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:32.376785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1130/2240] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:32.397429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:32.399476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:32.557749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299d32-f3ff-493b-891f-2d546979e67c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:32.582802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:32.587430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:32.587430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:32.587430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:32.631971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:32.633484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:32.659868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1111/2241] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:32.991904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:33.584729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:33.586741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:33.625026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c5e7d-07df-438e-b19d-37afc4d9fbef None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:33.637360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:33.641213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:33.641213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:33.641213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] PATH_INFO: `/v3/projects/254ab80a5e964623871b5ae8c68b122d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:33.646512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254ab80a5e964623871b5ae8c68b122d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:33.650187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:33.861458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254ab80a5e964623871b5ae8c68b122d', 'request_id': 'req-c66e35ef-9fec-4e6e-9614-6010d2a36255'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:33.908204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254ab80a5e964623871b5ae8c68b122d', 'request_id': 'req-c66e35ef-9fec-4e6e-9614-6010d2a36255'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:34.027955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254ab80a5e964623871b5ae8c68b122d', 'request_id': 'req-c66e35ef-9fec-4e6e-9614-6010d2a36255'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:34.046922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] The token cache is being invalidate because project 254ab80a5e964623871b5ae8c68b122d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:34.047640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:34.050009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c66e35ef-9fec-4e6e-9614-6010d2a36255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:34.052798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1131/2242] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:33 2022] DELETE /identity/v3/projects/254ab80a5e964623871b5ae8c68b122d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:34.953822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:35.057578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:36.750587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:36.753050 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:36.774099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad1b3-6615-475b-9b27-efb7b26ea97a service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:36.941615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:36.942390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:36.942745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:36.943161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] PATH_INFO: `/v3/users/cdd3c6ab46184c86b2b8f9c436e5d488` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:36.945220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd3c6ab46184c86b2b8f9c436e5d488)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:36.947992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:37.090120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:37.189155 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:37.207735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd3c6ab46184c86b2b8f9c436e5d488'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:37.217109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd3c6ab46184c86b2b8f9c436e5d488'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:37.319006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd3c6ab46184c86b2b8f9c436e5d488'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:37.319959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd3c6ab46184c86b2b8f9c436e5d488'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:37.349104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd3c6ab46184c86b2b8f9c436e5d488'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:37.356008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1112/2243] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:36 2022] DELETE /identity/v3/users/cdd3c6ab46184c86b2b8f9c436e5d488 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:37.361211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a750fc-eaae-426b-811b-82925234f050 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:37.361979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a750fc-eaae-426b-811b-82925234f050 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:37.362233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a750fc-eaae-426b-811b-82925234f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:37.400543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c1a750fc-eaae-426b-811b-82925234f050 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:37.402308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c1a750fc-eaae-426b-811b-82925234f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:37.506308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1132/2244] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:37.507150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:37.507150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:37.575142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863fe5-441a-43ab-ac66-0ff2d1e8a4a3 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:37.582503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:37.583087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:37.583378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:37.583661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:37.627247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:37.629671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:37.643183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1113/2245] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:38.138503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1ce8c-4186-4eb3-9e78-3c622c83b2d4 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:38.138804 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1ce8c-4186-4eb3-9e78-3c622c83b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:38.139085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1ce8c-4186-4eb3-9e78-3c622c83b2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:38.183077 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8cc1ce8c-4186-4eb3-9e78-3c622c83b2d4 None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:38.184698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8cc1ce8c-4186-4eb3-9e78-3c622c83b2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:38.305627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1133/2246] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 1 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:38.326625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:38.326625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:38.430554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:38.431056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:38.431547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:38.448657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffabbf-acb3-4ac7-9d58-205707ad0ba2 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:38.454139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:38.454876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:38.455220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:38.455695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:38.465042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:38.465184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] MFA Rules not processed for user `8aaabcf6ef144ff98e700f2f031ff3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:38.466331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:38.469536 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:38.480224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1114/2247] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:00:38.519716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:38.521213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:38.543687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd29c1-9ba3-4956-aca6-f83bcfc07a77 service swift] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:38.551439 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:38.552415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:38.552707 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:38.553022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] PATH_INFO: `/v3/projects/23649fb47259424cbe4512fb48485955` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:38.554927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23649fb47259424cbe4512fb48485955)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:38.558182 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:38.572191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1134/2248] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:38.576768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:38.578360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:38.596711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791505b3-871d-4507-92e0-490f597be3a2 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:38.601454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:38.602228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:38.602613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:38.602998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:38.604696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:38.607518 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:38.736413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1135/2249] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:38 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:38.740578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:38.754251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23649fb47259424cbe4512fb48485955', 'request_id': 'req-08718f03-6632-4e12-ac23-f1c36021af9d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:38.771331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23649fb47259424cbe4512fb48485955', 'request_id': 'req-08718f03-6632-4e12-ac23-f1c36021af9d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:38.824244 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10af59-a863-426f-86f1-dd6f24cdf584 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:38.897628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:38.898250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:38.898540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:38.898824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:38.899501 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:38.903275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23649fb47259424cbe4512fb48485955', 'request_id': 'req-08718f03-6632-4e12-ac23-f1c36021af9d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:38.906791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:38.918880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] The token cache is being invalidate because project 23649fb47259424cbe4512fb48485955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:38.918880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:38.919678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:38.921348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1115/2250] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:38 2022] DELETE /identity/v3/projects/23649fb47259424cbe4512fb48485955 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:00:38.925234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:38.926673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:38.941429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718f03-6632-4e12-ac23-f1c36021af9d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:38.950469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:38.951140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:38.951426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:38.954240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] PATH_INFO: `/v3/users/e4cfa075ce13434f9a912dacf2da54b2` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:38.954240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cfa075ce13434f9a912dacf2da54b2)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:38.955239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:39.016697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1136/2251] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:38 2022] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:39.017931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:39.021054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:39.034308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123126-402f-42b3-9f6b-08118bc02669 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:39.039188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:39.039922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:39.040273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:39.040623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:39.041396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:39.043589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:39.058025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1137/2252] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:39.062597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:39.074638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f740-11c4-496e-a440-8e1a45831667 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:39.087115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:39.087115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:39.087115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:39.087115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] PATH_INFO: `/v3/projects/796def07714f4cb89edff7821ad099a2/users/73e9a6800a9b43daa7bd98ffe13691df/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:39.106519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796def07714f4cb89edff7821ad099a2, user_id=73e9a6800a9b43daa7bd98ffe13691df, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:39.109376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:39.204846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cfa075ce13434f9a912dacf2da54b2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:39.215116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cfa075ce13434f9a912dacf2da54b2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:39.227326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1138/2253] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:39 2022] PUT /identity/v3/projects/796def07714f4cb89edff7821ad099a2/users/73e9a6800a9b43daa7bd98ffe13691df/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:00:39.228584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:39.333307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cfa075ce13434f9a912dacf2da54b2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:39.334709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cfa075ce13434f9a912dacf2da54b2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:39.349245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e9fa0-373c-4d5d-8ade-b79aeb33e620 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:39.350087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cfa075ce13434f9a912dacf2da54b2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:39.357474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1116/2254] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:38 2022] DELETE /identity/v3/users/e4cfa075ce13434f9a912dacf2da54b2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:39.372417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00634375-be5d-4e0d-a259-00e0d2bc40b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:39.373072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634375-be5d-4e0d-a259-00e0d2bc40b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:39.373358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634375-be5d-4e0d-a259-00e0d2bc40b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:39.373701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634375-be5d-4e0d-a259-00e0d2bc40b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:39.374430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00634375-be5d-4e0d-a259-00e0d2bc40b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:39.376102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00634375-be5d-4e0d-a259-00e0d2bc40b4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:39.397802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1139/2255] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:00:39.402222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:39.405403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:39.572231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105e7c-c56a-4be9-8b14-62594aca9d42 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:39.600490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:39.601564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:39.602067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:39.602542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] PATH_INFO: `/v3/projects/796def07714f4cb89edff7821ad099a2/users/73e9a6800a9b43daa7bd98ffe13691df/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:39.605009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796def07714f4cb89edff7821ad099a2, user_id=73e9a6800a9b43daa7bd98ffe13691df, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:39.608186 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:39.627557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1117/2256] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:39 2022] PUT /identity/v3/projects/796def07714f4cb89edff7821ad099a2/users/73e9a6800a9b43daa7bd98ffe13691df/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:39.986042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a115-504a-4d35-957e-fa3772b93b60 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:39.986635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a115-504a-4d35-957e-fa3772b93b60 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:39.987647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a115-504a-4d35-957e-fa3772b93b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:40.034475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9e91a115-504a-4d35-957e-fa3772b93b60 None None] MFA Rules not processed for user `2c1113cbce924ad9b68690db65c58232`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:40.038363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9e91a115-504a-4d35-957e-fa3772b93b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:40.114147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1140/2257] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:40.189659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:40.189659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:40.309986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122778f-4982-4966-8152-782d191d3590 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:40.316119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:40.316791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:40.317736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:40.318017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] PATH_INFO: `/v3/projects/6180b2e2a29644bc824ad1c686e65fd0` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:40.319223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6180b2e2a29644bc824ad1c686e65fd0)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:40.321424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:40.521154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6180b2e2a29644bc824ad1c686e65fd0', 'request_id': 'req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:40.527429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6180b2e2a29644bc824ad1c686e65fd0', 'request_id': 'req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:40.653143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6180b2e2a29644bc824ad1c686e65fd0', 'request_id': 'req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:40.682026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] The token cache is being invalidate because project 6180b2e2a29644bc824ad1c686e65fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:40.682498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:40.683776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2c9f7d04-fa6c-4261-b52f-952a2adfab9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:40.686382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1118/2258] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:40 2022] DELETE /identity/v3/projects/6180b2e2a29644bc824ad1c686e65fd0 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:40.690557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a115-504a-4d35-957e-fa3772b93b60 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:40.704446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a115-504a-4d35-957e-fa3772b93b60 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:40.789386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:40.800352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:40.801016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:40.801404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:40.801786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] PATH_INFO: `/v3/users/649a765e2c4b441998a613d4225f702d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:40.803575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=649a765e2c4b441998a613d4225f702d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:40.805693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:40.876078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:41.031352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649a765e2c4b441998a613d4225f702d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:41.032787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649a765e2c4b441998a613d4225f702d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:41.033636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649a765e2c4b441998a613d4225f702d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:41.046827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649a765e2c4b441998a613d4225f702d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:41.060711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649a765e2c4b441998a613d4225f702d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:41.206408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1141/2259] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:40 2022] DELETE /identity/v3/users/649a765e2c4b441998a613d4225f702d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:41.775885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:41.776470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:41.776470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:41.809139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] MFA Rules not processed for user `1f30bfa8b6e2449493810c05754bf8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:41.817300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:41.898062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1119/2260] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:42.195467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:42.381436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:42.383521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:42.583850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfefbff-c1df-4b9b-a970-67ae37aea4ec admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:42.592797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:42.594537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:42.594833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:42.595121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] PATH_INFO: `/v3/projects/de7b9bd90eac420281efeeced7596abe` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:42.597190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7b9bd90eac420281efeeced7596abe)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:42.599597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:42.764022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7b9bd90eac420281efeeced7596abe', 'request_id': 'req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:42.784705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7b9bd90eac420281efeeced7596abe', 'request_id': 'req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:42.886726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7b9bd90eac420281efeeced7596abe', 'request_id': 'req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:42.910677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] The token cache is being invalidate because project de7b9bd90eac420281efeeced7596abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:42.910996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:42.911698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:42.913468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1142/2261] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:42 2022] DELETE /identity/v3/projects/de7b9bd90eac420281efeeced7596abe => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:42.987969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:43.629303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:43.630772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:43.654115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54d639-b874-4221-9958-8aab2a39bf7c None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:43.753989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:43.756961 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:43.757429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:43.758102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] PATH_INFO: `/v3/users/8087cdf690014a7b9e7bafcd8c8d7efe` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:43.760412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8087cdf690014a7b9e7bafcd8c8d7efe)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:43.762944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:44.060000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8087cdf690014a7b9e7bafcd8c8d7efe'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:44.077434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8087cdf690014a7b9e7bafcd8c8d7efe'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:44.216200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8087cdf690014a7b9e7bafcd8c8d7efe'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:44.217425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8087cdf690014a7b9e7bafcd8c8d7efe'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:44.234926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-8bacab67-a6af-43f2-9417-c7e96f5b8b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8087cdf690014a7b9e7bafcd8c8d7efe'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:44.242851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1120/2262] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:00:43 2022] DELETE /identity/v3/users/8087cdf690014a7b9e7bafcd8c8d7efe => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:44.249708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:44.742181 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:44.743800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:44.777769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b07d2-e9f4-4c1f-85b8-1d4e9f113f1b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:44.869230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:44.870056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:44.870345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:44.870769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] PATH_INFO: `/v3/projects/6d9096d239c748e1b24078a2b45527ee` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:44.872072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9096d239c748e1b24078a2b45527ee)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:44.874296 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:45.018674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9096d239c748e1b24078a2b45527ee', 'request_id': 'req-589739e0-9f32-44c1-b04a-eed5d4143aff'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:45.026242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9096d239c748e1b24078a2b45527ee', 'request_id': 'req-589739e0-9f32-44c1-b04a-eed5d4143aff'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:45.114581 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9096d239c748e1b24078a2b45527ee', 'request_id': 'req-589739e0-9f32-44c1-b04a-eed5d4143aff'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:45.129124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] The token cache is being invalidate because project 6d9096d239c748e1b24078a2b45527ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:00:45.129533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:45.130262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-589739e0-9f32-44c1-b04a-eed5d4143aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:00:45.133362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1143/2263] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:00:44 2022] DELETE /identity/v3/projects/6d9096d239c748e1b24078a2b45527ee => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:45.140796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983372-4e52-48d0-8e6d-0282210aacb6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.141346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983372-4e52-48d0-8e6d-0282210aacb6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.141346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983372-4e52-48d0-8e6d-0282210aacb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.162453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d3983372-4e52-48d0-8e6d-0282210aacb6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:45.163670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d3983372-4e52-48d0-8e6d-0282210aacb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:45.231640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1121/2264] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:45.240339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966c34-c98d-457c-b265-bc950ec69ee0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.240684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966c34-c98d-457c-b265-bc950ec69ee0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.240989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966c34-c98d-457c-b265-bc950ec69ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.262877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c4966c34-c98d-457c-b265-bc950ec69ee0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:45.264627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c4966c34-c98d-457c-b265-bc950ec69ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:45.274547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1144/2265] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:45.278633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983372-4e52-48d0-8e6d-0282210aacb6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:45.289832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983372-4e52-48d0-8e6d-0282210aacb6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:45.295858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:45.296499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.296785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.297060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.298160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:00:45.299273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:45.301429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:45.315583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1122/2266] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:00:45.320008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4966c34-c98d-457c-b265-bc950ec69ee0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:45.330698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4966c34-c98d-457c-b265-bc950ec69ee0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:45.335723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:45.336351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.336639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.336920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.337837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:45.339807 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:45.481355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1145/2267] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:00:45 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:00:45.482239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:45.518799 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cc95f-3af5-4dbe-b513-c7d6d56175a3 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:45.583747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:45.592907 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:45.593582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.593873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.594156 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.594831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:45.597343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:45.736284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1123/2268] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:00:45 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:00:45.740642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:45.768806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35759f51-a9e4-4bd5-8c80-f71d5a3814d4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:45.794206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:45.795109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.795683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.796116 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.797046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:45.802059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:45.820545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1146/2269] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:45.825180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:45.840521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22c871-7f87-4ace-b89b-8904d50967e1 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:45.846848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c194-6c72-4233-a43e-65f4290a706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:45.848117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c194-6c72-4233-a43e-65f4290a706b admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.848689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c194-6c72-4233-a43e-65f4290a706b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.849207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c194-6c72-4233-a43e-65f4290a706b admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.850901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5c194-6c72-4233-a43e-65f4290a706b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:45.853542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5c194-6c72-4233-a43e-65f4290a706b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:45.870466 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1124/2270] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:00:45.871663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:45.888099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4a922-00b3-4b19-a92d-37ed91ed3d33 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:45.899231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:45.900257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:45.900257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:45.900492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] PATH_INFO: `/v3/projects/fe2fa81f7c90428998ff6a86d04564b7/users/42a7ed0027ed47d5a9a37f5690cac5df/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:45.940347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2fa81f7c90428998ff6a86d04564b7, user_id=42a7ed0027ed47d5a9a37f5690cac5df, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:45.943331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:46.036220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1147/2271] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:00:45 2022] PUT /identity/v3/projects/fe2fa81f7c90428998ff6a86d04564b7/users/42a7ed0027ed47d5a9a37f5690cac5df/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:00:46.037261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e672d2-7094-4960-a4e3-1826ffee9bb9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:46.037598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e672d2-7094-4960-a4e3-1826ffee9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:46.037886 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e672d2-7094-4960-a4e3-1826ffee9bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:46.096592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c8e672d2-7094-4960-a4e3-1826ffee9bb9 None None] MFA Rules not processed for user `42a7ed0027ed47d5a9a37f5690cac5df`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:46.098130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c8e672d2-7094-4960-a4e3-1826ffee9bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:46.205879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1125/2272] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:46.218377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:46.221091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:46.358160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457107ce-9a21-4e7a-b20e-14b609c9b485 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:46.364275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:46.365058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:46.365349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:46.365872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:46.376402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:46.378490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:46.389415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1148/2273] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:46.740313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:47.655351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:48.320591 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:49.292271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:49.412132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:50.176621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:50.249707 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:50.313314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ddcf0-85de-44f4-87ed-92131aeac8ae None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:50.313923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ddcf0-85de-44f4-87ed-92131aeac8ae None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:50.314265 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ddcf0-85de-44f4-87ed-92131aeac8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:50.361843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1c0ddcf0-85de-44f4-87ed-92131aeac8ae None None] MFA Rules not processed for user `73e9a6800a9b43daa7bd98ffe13691df`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:50.363174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1c0ddcf0-85de-44f4-87ed-92131aeac8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:50.473222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1126/2274] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:50.482319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:50.484660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:50.527048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea065a-f02f-4518-b650-8cbc9b2ac692 service glance] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:50.543262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:50.543940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:50.544228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:50.545846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:50.550332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:50.641038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:50.642557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:50.654265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1149/2275] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:00:50.869467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:51.003110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3dc0-f85e-4c0d-826e-2fdd42bc00ae None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:51.003519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3dc0-f85e-4c0d-826e-2fdd42bc00ae None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:51.003877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3dc0-f85e-4c0d-826e-2fdd42bc00ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:51.026593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-6e1b3dc0-f85e-4c0d-826e-2fdd42bc00ae None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:00:51.028652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6e1b3dc0-f85e-4c0d-826e-2fdd42bc00ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:51.098237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1127/2276] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:00:51.113968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:51.115888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:51.203290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0beee-bc47-4ada-ad94-23e5970f0144 service glance] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:51.209468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:51.210165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:51.210452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:51.210731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:51.219933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:51.223051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:51.230435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1150/2277] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:00:51.324798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:51.944141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:52.040618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:52.989704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:53.633686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:53.783159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:54.738089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:55.438304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:55.512761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:56.172276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:56.474620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:57.383010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:57.547638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:57.793070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:57.906729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:57.954694 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:58.622879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:59.061596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:59.652198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:59.874482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:00.149243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:00.207032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:00.645937 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:00.674463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:01.274195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa056-1622-483e-867a-bdc72b725f07 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:01.274862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa056-1622-483e-867a-bdc72b725f07 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:01.274862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa056-1622-483e-867a-bdc72b725f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:01.298565 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-fe2fa056-1622-483e-867a-bdc72b725f07 None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:01.301112 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fe2fa056-1622-483e-867a-bdc72b725f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:01.333633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1128/2278] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:01:01.338815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:01.354590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfca17-8533-46d7-b746-213ef8921817 service swift] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:01.381723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d3789-e744-4723-b2a5-7e8b722ffb6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:01.386784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:01.386784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d3789-e744-4723-b2a5-7e8b722ffb6e service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:01.386784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d3789-e744-4723-b2a5-7e8b722ffb6e service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:01.386784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d3789-e744-4723-b2a5-7e8b722ffb6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:01.398130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d3789-e744-4723-b2a5-7e8b722ffb6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:01.400229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d3789-e744-4723-b2a5-7e8b722ffb6e service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:01.416053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1151/2279] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:01:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:01:01.467634 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:01.772387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:01.813819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:02.124390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:02.159001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:02.351906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:02.378247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:03.035182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:03.296074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:03.650224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:03.749122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.021325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.051904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.158268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.419122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.607859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.687232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.847277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.930176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:05.212298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8882d0-37ed-471f-b67d-368b609e1ccb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:05.212845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8882d0-37ed-471f-b67d-368b609e1ccb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:05.213313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8882d0-37ed-471f-b67d-368b609e1ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:05.224377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:05.246317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4c8882d0-37ed-471f-b67d-368b609e1ccb None None] MFA Rules not processed for user `8aaabcf6ef144ff98e700f2f031ff3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:05.248027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4c8882d0-37ed-471f-b67d-368b609e1ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:05.256943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1129/2280] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:01:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:05.278381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:05.651112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:06.274430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:06.549500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:07.200996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:07.264448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:10.499327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b7a0-fc59-491d-acb7-83def97793da None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:10.500034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b7a0-fc59-491d-acb7-83def97793da None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:10.500034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b7a0-fc59-491d-acb7-83def97793da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:10.523494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0388b7a0-fc59-491d-acb7-83def97793da None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:10.523494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0388b7a0-fc59-491d-acb7-83def97793da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:10.532250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1152/2281] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:10.546276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8882d0-37ed-471f-b67d-368b609e1ccb None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:10.559824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8882d0-37ed-471f-b67d-368b609e1ccb None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:10.566211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7c931-80ab-4187-8aca-70cdc781362e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:10.567136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7c931-80ab-4187-8aca-70cdc781362e service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:10.567831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7c931-80ab-4187-8aca-70cdc781362e service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:10.568360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7c931-80ab-4187-8aca-70cdc781362e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:10.578599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7c931-80ab-4187-8aca-70cdc781362e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:10.580850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7c931-80ab-4187-8aca-70cdc781362e service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:10.591444 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1130/2282] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:01:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:01:20.516076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=82 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:20.587749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=51 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:22.553961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b7a0-fc59-491d-acb7-83def97793da None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:22.621654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b7a0-fc59-491d-acb7-83def97793da None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:22.626156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:22.627338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:22.627619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:22.627920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] PATH_INFO: `/v3/users/42a7ed0027ed47d5a9a37f5690cac5df` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:22.629101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a7ed0027ed47d5a9a37f5690cac5df)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:22.631057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:23.016764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a7ed0027ed47d5a9a37f5690cac5df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:23.017619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a7ed0027ed47d5a9a37f5690cac5df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:23.018569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a7ed0027ed47d5a9a37f5690cac5df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:23.030987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a7ed0027ed47d5a9a37f5690cac5df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:23.057542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a7ed0027ed47d5a9a37f5690cac5df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:23.124400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1153/2283] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:01:22 2022] DELETE /identity/v3/users/42a7ed0027ed47d5a9a37f5690cac5df => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:01:23.129791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:23.130307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:23.130307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:23.149919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:23.151134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:23.215492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1131/2284] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:23.225156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:23.226737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:23.301121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39f98-e968-488e-a5ec-5f22325f9d49 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:23.301121 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d28b0-c907-4e31-a0cf-10f36d2cbd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:23.301344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d28b0-c907-4e31-a0cf-10f36d2cbd00 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:23.301473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d28b0-c907-4e31-a0cf-10f36d2cbd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:23.301790 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d28b0-c907-4e31-a0cf-10f36d2cbd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:23.311703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d28b0-c907-4e31-a0cf-10f36d2cbd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:23.313332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d28b0-c907-4e31-a0cf-10f36d2cbd00 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:23.323776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1154/2285] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:23.737486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:23.739194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:23.752473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30883bb-c6a6-4063-9058-f3e779ce1494 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:23.758037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:23.758862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:23.759073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:23.759363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] PATH_INFO: `/v3/projects/fe2fa81f7c90428998ff6a86d04564b7` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:23.771596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2fa81f7c90428998ff6a86d04564b7)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:23.774906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:23.918549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2fa81f7c90428998ff6a86d04564b7', 'request_id': 'req-27284ad3-e318-448a-859c-a43cb4230d4d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:23.924177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2fa81f7c90428998ff6a86d04564b7', 'request_id': 'req-27284ad3-e318-448a-859c-a43cb4230d4d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:23.992109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2fa81f7c90428998ff6a86d04564b7', 'request_id': 'req-27284ad3-e318-448a-859c-a43cb4230d4d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:24.010298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] The token cache is being invalidate because project fe2fa81f7c90428998ff6a86d04564b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:01:24.010594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:24.011992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-27284ad3-e318-448a-859c-a43cb4230d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:24.013503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1132/2286] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:01:23 2022] DELETE /identity/v3/projects/fe2fa81f7c90428998ff6a86d04564b7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:01:24.019107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9e5c-d798-4ccd-87d2-b5faf142e0fd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.019875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9e5c-d798-4ccd-87d2-b5faf142e0fd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.019875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9e5c-d798-4ccd-87d2-b5faf142e0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.040764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e14e9e5c-d798-4ccd-87d2-b5faf142e0fd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:24.042100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e14e9e5c-d798-4ccd-87d2-b5faf142e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:24.059485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:24.111301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1155/2287] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:24.112953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c8341-d29d-4a61-94b8-805e27fac9ed None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.113242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c8341-d29d-4a61-94b8-805e27fac9ed None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.113543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c8341-d29d-4a61-94b8-805e27fac9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.134495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f63c8341-d29d-4a61-94b8-805e27fac9ed None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:24.136155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f63c8341-d29d-4a61-94b8-805e27fac9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:24.144918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1133/2288] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:24.150305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e9e5c-d798-4ccd-87d2-b5faf142e0fd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:24.159708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e9e5c-d798-4ccd-87d2-b5faf142e0fd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:24.164502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:24.165048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.165347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.165692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.166393 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:01:24.166692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:24.168280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:24.185390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1156/2289] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:01:24.190306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c8341-d29d-4a61-94b8-805e27fac9ed None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:24.196811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c8341-d29d-4a61-94b8-805e27fac9ed None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:24.201686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:24.202485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.202770 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.203049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.203742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:24.206220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:24.369393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1134/2290] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:01:24 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:01:24.372300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:24.382085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1c2f2-63a8-4d6a-a38b-0642ee3d1715 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:24.442758 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:24.443374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.443679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.443956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.444610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:24.446745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:24.568376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1157/2291] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:01:24 2022] POST /identity/v3/users => generated 282 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:01:24.572881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:24.587383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cd2eb-d2d8-42aa-adce-79a6d623228f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:24.592333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:24.594394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.594394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.594394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.594394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:24.596072 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:24.612943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1135/2292] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:01:24.617213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:24.628799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635253c-b6d6-4344-8cc0-a0c20e63788d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:24.633892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c8397-e782-4ad3-9052-feb4dc555c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:24.634585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c8397-e782-4ad3-9052-feb4dc555c3d admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.634941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c8397-e782-4ad3-9052-feb4dc555c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.635227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c8397-e782-4ad3-9052-feb4dc555c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.635927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c8397-e782-4ad3-9052-feb4dc555c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:24.637547 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c8397-e782-4ad3-9052-feb4dc555c3d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:24.651962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1158/2293] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:01:24.652920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:24.665447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de19d0-0e38-4fdb-a996-fb8f024cb472 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:24.672375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:24.672375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.672375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.672375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] PATH_INFO: `/v3/projects/0920e1d1183e407faaab32a9f743c082/users/2e689178286948b3b3d03ec5ce5ae051/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.688420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0920e1d1183e407faaab32a9f743c082, user_id=2e689178286948b3b3d03ec5ce5ae051, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:24.694166 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:24.770244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1136/2294] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:01:24 2022] PUT /identity/v3/projects/0920e1d1183e407faaab32a9f743c082/users/2e689178286948b3b3d03ec5ce5ae051/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:01:24.786601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbb20-55bb-4243-bec4-391798095bf9 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:24.786601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbb20-55bb-4243-bec4-391798095bf9 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:24.786601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbb20-55bb-4243-bec4-391798095bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:24.818178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e43bbb20-55bb-4243-bec4-391798095bf9 None None] MFA Rules not processed for user `2e689178286948b3b3d03ec5ce5ae051`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:24.818977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e43bbb20-55bb-4243-bec4-391798095bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:24.919957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1159/2295] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:24.934271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:24.936599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:24.970274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:25.011603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb2824-c939-4a48-8d80-1f1017377bdf admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:25.017167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1e772-8756-4662-a011-bce97449edee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:25.018096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1e772-8756-4662-a011-bce97449edee service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:25.018518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1e772-8756-4662-a011-bce97449edee service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:25.018858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1e772-8756-4662-a011-bce97449edee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:25.029890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1e772-8756-4662-a011-bce97449edee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:25.031939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1e772-8756-4662-a011-bce97449edee service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:25.043882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1137/2296] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:01:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:32.247673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b688ce-ab18-4df7-85b6-159632626a77 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.250048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b688ce-ab18-4df7-85b6-159632626a77 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.250048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b688ce-ab18-4df7-85b6-159632626a77 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.250048 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1160/2297] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 16:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 16:01:32.256305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c523be-003d-4ae9-8608-ee52acd7c650 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.256759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c523be-003d-4ae9-8608-ee52acd7c650 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.257023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c523be-003d-4ae9-8608-ee52acd7c650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.278665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e9c523be-003d-4ae9-8608-ee52acd7c650 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:32.280017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e9c523be-003d-4ae9-8608-ee52acd7c650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:32.370551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1138/2298] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:32.383869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b688ce-ab18-4df7-85b6-159632626a77 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:32.385727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-07b688ce-ab18-4df7-85b6-159632626a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:32.408901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:32.448642 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b688ce-ab18-4df7-85b6-159632626a77 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:32.452275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134df34-2aa9-4303-a248-655b2f4c5d98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:32.452901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134df34-2aa9-4303-a248-655b2f4c5d98 service glance] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.453182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134df34-2aa9-4303-a248-655b2f4c5d98 service glance] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.453457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134df34-2aa9-4303-a248-655b2f4c5d98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.464511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134df34-2aa9-4303-a248-655b2f4c5d98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:32.466006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134df34-2aa9-4303-a248-655b2f4c5d98 service glance] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:32.477935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1161/2299] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:32.694064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb25fd-8ec4-47c2-bed4-730b6b3ba392 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.701596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb25fd-8ec4-47c2-bed4-730b6b3ba392 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.701596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb25fd-8ec4-47c2-bed4-730b6b3ba392 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.701596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1139/2300] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 16:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 16:01:32.701903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7330754-241f-4ea5-be64-b4cd224083ae None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.701903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7330754-241f-4ea5-be64-b4cd224083ae None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.701903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7330754-241f-4ea5-be64-b4cd224083ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.721360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c7330754-241f-4ea5-be64-b4cd224083ae None None] MFA Rules not processed for user `90399c6cab2341f1af74d154c819bff9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:32.722578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c7330754-241f-4ea5-be64-b4cd224083ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:32.774332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1162/2301] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:32.786226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb25fd-8ec4-47c2-bed4-730b6b3ba392 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:32.787906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-88cb25fd-8ec4-47c2-bed4-730b6b3ba392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:32.801645 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb25fd-8ec4-47c2-bed4-730b6b3ba392 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:32.805180 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc314134-e291-4054-ae5c-f59ea323b21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:32.805822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314134-e291-4054-ae5c-f59ea323b21f service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.806110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314134-e291-4054-ae5c-f59ea323b21f service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.806395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314134-e291-4054-ae5c-f59ea323b21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.813970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc314134-e291-4054-ae5c-f59ea323b21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:32.816037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc314134-e291-4054-ae5c-f59ea323b21f service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:32.823800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1140/2302] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:32.907293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90e16a-f098-4651-b3ba-fb45c03050bd None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.907578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90e16a-f098-4651-b3ba-fb45c03050bd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.907863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90e16a-f098-4651-b3ba-fb45c03050bd None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.909496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1163/2303] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 16:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 16:01:32.914897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.915195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.915721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.938008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:32.938008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:32.947955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1141/2304] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:32.961561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90e16a-f098-4651-b3ba-fb45c03050bd None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:32.964123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-da90e16a-f098-4651-b3ba-fb45c03050bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:32.979314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90e16a-f098-4651-b3ba-fb45c03050bd None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:32.983190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19206791-be4f-46e5-a340-26fe1bf8c673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:32.983920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206791-be4f-46e5-a340-26fe1bf8c673 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:32.984302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206791-be4f-46e5-a340-26fe1bf8c673 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:32.984693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206791-be4f-46e5-a340-26fe1bf8c673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:32.996120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19206791-be4f-46e5-a340-26fe1bf8c673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:32.997623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19206791-be4f-46e5-a340-26fe1bf8c673 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:33.009956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1164/2305] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:35.245754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:35.247207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:35.336287 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92282-61f7-4e57-a732-f0254dad1c92 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:35.343951 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:35.344699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:35.345185 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:35.345541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:35.348170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:35.361170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:35.362890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:35.374146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1142/2306] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:01:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:37.290677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48745-2c0b-48e4-8deb-45a1d0ac1eca None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:37.293760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48745-2c0b-48e4-8deb-45a1d0ac1eca None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:37.293760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48745-2c0b-48e4-8deb-45a1d0ac1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:37.314458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-efd48745-2c0b-48e4-8deb-45a1d0ac1eca None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:37.316226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-efd48745-2c0b-48e4-8deb-45a1d0ac1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:37.372855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1165/2307] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:01:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:37.386399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:37.387949 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:37.417755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:37.458538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc726a-4b70-426b-adea-87e7120585d7 service placement] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:37.463696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e7c6c-7e68-401b-8980-ca7131b76f05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:37.464343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e7c6c-7e68-401b-8980-ca7131b76f05 service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:37.464620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e7c6c-7e68-401b-8980-ca7131b76f05 service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:37.464898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e7c6c-7e68-401b-8980-ca7131b76f05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:37.486711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e7c6c-7e68-401b-8980-ca7131b76f05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:37.486711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e7c6c-7e68-401b-8980-ca7131b76f05 service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:37.488510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1143/2308] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:01:47.365192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=72 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:47.519958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=21 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:54.050468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48745-2c0b-48e4-8deb-45a1d0ac1eca None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:54.060836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48745-2c0b-48e4-8deb-45a1d0ac1eca None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:54.066001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:54.066980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:54.067516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:54.068567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:54.080719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:54.216131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:54.217809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:54.237509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1166/2309] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:01:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:59.056172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02116f5d-6676-4ea3-97df-6a3ae0ffc83e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:59.058261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02116f5d-6676-4ea3-97df-6a3ae0ffc83e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:59.058813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02116f5d-6676-4ea3-97df-6a3ae0ffc83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:59.081115 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-02116f5d-6676-4ea3-97df-6a3ae0ffc83e None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:01:59.083054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-02116f5d-6676-4ea3-97df-6a3ae0ffc83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:59.095494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1144/2310] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 1 16:01:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:01:59.113485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:59.128096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9a702-c273-4a47-96df-87909497805f service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:59.135922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c148a-e49f-4d4a-8817-33331cf644f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:59.136798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c148a-e49f-4d4a-8817-33331cf644f3 service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:59.137289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c148a-e49f-4d4a-8817-33331cf644f3 service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:59.137799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c148a-e49f-4d4a-8817-33331cf644f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:59.149314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c148a-e49f-4d4a-8817-33331cf644f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:59.151256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c148a-e49f-4d4a-8817-33331cf644f3 service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:59.165379 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1167/2311] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:02:06.426496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02116f5d-6676-4ea3-97df-6a3ae0ffc83e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:06.512075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02116f5d-6676-4ea3-97df-6a3ae0ffc83e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:06.516809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:06.517584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:06.518933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:06.518933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] PATH_INFO: `/v3/users/2e689178286948b3b3d03ec5ce5ae051` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:06.519507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e689178286948b3b3d03ec5ce5ae051)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:06.521567 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:06.801808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e689178286948b3b3d03ec5ce5ae051'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:06.808958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e689178286948b3b3d03ec5ce5ae051'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:06.883381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e689178286948b3b3d03ec5ce5ae051'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:06.884068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e689178286948b3b3d03ec5ce5ae051'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:06.900223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e689178286948b3b3d03ec5ce5ae051'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:06.911727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1145/2312] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:02:06 2022] DELETE /identity/v3/users/2e689178286948b3b3d03ec5ce5ae051 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:02:06.913701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:06.914585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:06.915050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:06.949634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:06.951074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:07.055958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1168/2313] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:02:07.063826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:07.065310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:07.147846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89309f8-e54e-46b7-b7cb-9b9f35060b17 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:07.152223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ad6e9-a327-4f6f-b73c-8c35e0bbcd3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:07.153052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ad6e9-a327-4f6f-b73c-8c35e0bbcd3f service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:07.153338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ad6e9-a327-4f6f-b73c-8c35e0bbcd3f service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:07.153666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ad6e9-a327-4f6f-b73c-8c35e0bbcd3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:07.165712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ad6e9-a327-4f6f-b73c-8c35e0bbcd3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:07.167624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ad6e9-a327-4f6f-b73c-8c35e0bbcd3f service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:07.179710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1146/2314] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:02:07.704030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:07.704030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:07.712016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c8ea-4be4-459c-9921-224af19bd385 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:07.717297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:07.718000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:07.718285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:07.718611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] PATH_INFO: `/v3/projects/0920e1d1183e407faaab32a9f743c082` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:07.719880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0920e1d1183e407faaab32a9f743c082)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:07.724589 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:07.857006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0920e1d1183e407faaab32a9f743c082', 'request_id': 'req-1c59a95e-5524-4dad-8a12-8a39d12250dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:07.866471 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0920e1d1183e407faaab32a9f743c082', 'request_id': 'req-1c59a95e-5524-4dad-8a12-8a39d12250dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:07.940545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0920e1d1183e407faaab32a9f743c082', 'request_id': 'req-1c59a95e-5524-4dad-8a12-8a39d12250dd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:07.952180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] The token cache is being invalidate because project 0920e1d1183e407faaab32a9f743c082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:02:07.952392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:07.953017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1c59a95e-5524-4dad-8a12-8a39d12250dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:02:07.954618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1169/2315] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:02:07 2022] DELETE /identity/v3/projects/0920e1d1183e407faaab32a9f743c082 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:02:07.959886 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a15e8-b81e-49b9-b217-523109735efd None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:07.960422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a15e8-b81e-49b9-b217-523109735efd None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:07.960503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a15e8-b81e-49b9-b217-523109735efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:07.982454 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8b3a15e8-b81e-49b9-b217-523109735efd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:07.983779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8b3a15e8-b81e-49b9-b217-523109735efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:07.995329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:08.064544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1147/2316] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:02:08.073369 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49adb08-809f-48d8-8382-6ed0473a677e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.073853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49adb08-809f-48d8-8382-6ed0473a677e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.073979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49adb08-809f-48d8-8382-6ed0473a677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.086934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:08.103057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-c49adb08-809f-48d8-8382-6ed0473a677e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:08.104304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c49adb08-809f-48d8-8382-6ed0473a677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:08.117427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1170/2317] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:02:08.122411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a15e8-b81e-49b9-b217-523109735efd None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:08.136906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a15e8-b81e-49b9-b217-523109735efd None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:08.142543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:08.143190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.143472 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.143748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.144507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:02:08.144862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:08.147095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:08.162233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1148/2318] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:02:08.166623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49adb08-809f-48d8-8382-6ed0473a677e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:08.176735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49adb08-809f-48d8-8382-6ed0473a677e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:08.185330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:08.185330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.185330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.185330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.187010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:08.187796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:08.300791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1171/2319] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:02:08 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:02:08.305775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:08.317138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3d857-0ee6-487f-a006-3fa649942eb6 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:08.378865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:08.379521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.379809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.380093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.380965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:08.382939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:08.547266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1149/2320] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:02:08 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:02:08.552098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:08.562812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474eee-bdd3-452e-b64e-06fb1fb8d5d7 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:08.568238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:08.568906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.569187 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.569495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.570240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:08.571875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:08.583184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1172/2321] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:02:08.587410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:08.597641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593cb06-abe1-41a4-8593-32d5748f7cc4 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:08.603329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34717721-ecf0-4bed-8734-e9ec7ead723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:08.603966 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34717721-ecf0-4bed-8734-e9ec7ead723b admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.604396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34717721-ecf0-4bed-8734-e9ec7ead723b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.604679 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34717721-ecf0-4bed-8734-e9ec7ead723b admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.605420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34717721-ecf0-4bed-8734-e9ec7ead723b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:08.607085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34717721-ecf0-4bed-8734-e9ec7ead723b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:08.620543 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1150/2322] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:02:08.624867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:08.635753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c59630-d251-42fc-a376-e7461ad1f175 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:08.640977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:08.641976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.642274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.643183 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] PATH_INFO: `/v3/projects/a9ce051b834143afa5159c5af3af6133/users/9da7be15ac034bc6abfad286614e4262/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.659594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ce051b834143afa5159c5af3af6133, user_id=9da7be15ac034bc6abfad286614e4262, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:08.662673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:08.744912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1173/2323] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:02:08 2022] PUT /identity/v3/projects/a9ce051b834143afa5159c5af3af6133/users/9da7be15ac034bc6abfad286614e4262/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:02:08.749031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13c9c3-a921-4dfc-9b94-b80a475b5b69 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.749324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13c9c3-a921-4dfc-9b94-b80a475b5b69 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.749648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13c9c3-a921-4dfc-9b94-b80a475b5b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.771383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-cd13c9c3-a921-4dfc-9b94-b80a475b5b69 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:08.772625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cd13c9c3-a921-4dfc-9b94-b80a475b5b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:08.839694 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1151/2324] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:02:08.850425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:08.852142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:08.917658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31cc9-d79b-425f-8aa2-53586df296c7 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:08.921400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:08.922143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:08.922439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:08.922720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:08.932730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:08.934231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:08.947859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1174/2325] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:02:10.833717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058eb1-e8ca-4b43-8076-e3cdf81d8481 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:10.834513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058eb1-e8ca-4b43-8076-e3cdf81d8481 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:10.834513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058eb1-e8ca-4b43-8076-e3cdf81d8481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:10.868209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1e058eb1-e8ca-4b43-8076-e3cdf81d8481 None None] MFA Rules not processed for user `9da7be15ac034bc6abfad286614e4262`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:10.869786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1e058eb1-e8ca-4b43-8076-e3cdf81d8481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:10.885538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:10.969627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1152/2326] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:02:10.986179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:02:10.988090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:11.082638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9af8-27e8-4787-bbda-4150a8a065b1 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:02:11.089381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79263116-f769-4bd2-968b-31095b641b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:02:11.090243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263116-f769-4bd2-968b-31095b641b1a service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:11.090618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263116-f769-4bd2-968b-31095b641b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:11.094385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263116-f769-4bd2-968b-31095b641b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:11.101214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79263116-f769-4bd2-968b-31095b641b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:02:11.102724 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79263116-f769-4bd2-968b-31095b641b1a service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:02:11.112955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1175/2327] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:02:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:02:13.191299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce9dd7-29b1-4375-8890-1c630b8c6cc9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:13.192388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce9dd7-29b1-4375-8890-1c630b8c6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:13.192572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce9dd7-29b1-4375-8890-1c630b8c6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:13.197542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78321e6-2f50-486f-8459-8340d2da5f1c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:13.198093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78321e6-2f50-486f-8459-8340d2da5f1c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:13.198093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78321e6-2f50-486f-8459-8340d2da5f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:13.213184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d3ce9dd7-29b1-4375-8890-1c630b8c6cc9 None None] MFA Rules not processed for user `9da7be15ac034bc6abfad286614e4262`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:13.214451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d3ce9dd7-29b1-4375-8890-1c630b8c6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:13.217968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b78321e6-2f50-486f-8459-8340d2da5f1c None None] MFA Rules not processed for user `2c1113cbce924ad9b68690db65c58232`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:13.219129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b78321e6-2f50-486f-8459-8340d2da5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:13.221930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1153/2328] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:02:13.268859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:13.284402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1176/2329] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:02:19.427069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20d6d-6edd-490b-bccc-4285611837e4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:19.427669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20d6d-6edd-490b-bccc-4285611837e4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:19.427669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20d6d-6edd-490b-bccc-4285611837e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:19.451070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b0b20d6d-6edd-490b-bccc-4285611837e4 None None] MFA Rules not processed for user `1f30bfa8b6e2449493810c05754bf8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:19.452311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b0b20d6d-6edd-490b-bccc-4285611837e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:19.523465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1154/2330] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:02:23.452613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:29.516173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=50 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:56.471576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:02:56.472129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:02:56.472129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:02:56.493537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] MFA Rules not processed for user `df9d84db168a4612be9e98681d12bcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:02:56.494755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:02:56.553033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1177/2331] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:00.062229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66478-2f5d-4c94-8dd4-4cff190f6912 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:00.062819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66478-2f5d-4c94-8dd4-4cff190f6912 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:00.062819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66478-2f5d-4c94-8dd4-4cff190f6912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:00.084582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a8e66478-2f5d-4c94-8dd4-4cff190f6912 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:00.085890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a8e66478-2f5d-4c94-8dd4-4cff190f6912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:00.096177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1155/2332] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:00.112263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:00.114475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:00.226876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdccae-473a-4f8e-88ff-f6c5cc8f401f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:00.232401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:00.233130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:00.233410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:00.233714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:00.242670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:00.244343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:00.254317 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1178/2333] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:05.328171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606116-b972-4325-8542-253677f0e3f9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:05.328727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606116-b972-4325-8542-253677f0e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:05.328727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606116-b972-4325-8542-253677f0e3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:05.349577 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-98606116-b972-4325-8542-253677f0e3f9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:05.350990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-98606116-b972-4325-8542-253677f0e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:05.359384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1156/2334] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:05.391242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:05.392780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:05.407641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da12a9-f3aa-4bdb-b27e-2a4c19338173 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:05.413298 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:05.413949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:05.414234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:05.414511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:05.423408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:05.425066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:05.436728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1179/2335] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:09.845113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4e12-239c-41f0-9cc9-1fb20f9cddb4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:09.845691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4e12-239c-41f0-9cc9-1fb20f9cddb4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:09.845822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4e12-239c-41f0-9cc9-1fb20f9cddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:09.865624 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4caf4e12-239c-41f0-9cc9-1fb20f9cddb4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:09.867089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4caf4e12-239c-41f0-9cc9-1fb20f9cddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:09.875022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1157/2336] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:09.891203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:09.902882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fc8f8-84d8-4b0d-b5c6-91d9a41d4126 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:09.908483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:09.909118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:09.909404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:09.909720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:09.918127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:09.919743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:09.929811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1180/2337] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:13.782876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe3a02-353b-4e6a-9470-7956a6768be4 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:13.783406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe3a02-353b-4e6a-9470-7956a6768be4 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:13.783525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe3a02-353b-4e6a-9470-7956a6768be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:13.803848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1ebe3a02-353b-4e6a-9470-7956a6768be4 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:13.804993 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1ebe3a02-353b-4e6a-9470-7956a6768be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:13.813396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1158/2338] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:13.828217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:13.839784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41430d3a-6025-4dbc-a0d9-43a7fb8d79a9 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:13.845375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:13.846028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:13.846316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:13.847462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:13.855978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:13.857618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:13.868264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1181/2339] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:18.055858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8465-6dea-4090-9d36-37435fde83fb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:18.056355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8465-6dea-4090-9d36-37435fde83fb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:18.056456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8465-6dea-4090-9d36-37435fde83fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:18.076964 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-badf8465-6dea-4090-9d36-37435fde83fb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:18.078198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-badf8465-6dea-4090-9d36-37435fde83fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:18.086161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1159/2340] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:18.101942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:18.113434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81923b9-14d0-4859-a40d-a5b2cfea770d service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:18.119426 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:18.120036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:18.120323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:18.120792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:18.129043 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:18.131217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:18.141508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1182/2341] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:22.302066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1a6f-d664-4fa4-9174-3648e7a51355 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:22.302541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1a6f-d664-4fa4-9174-3648e7a51355 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:22.302655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1a6f-d664-4fa4-9174-3648e7a51355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:22.323195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d34a1a6f-d664-4fa4-9174-3648e7a51355 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:22.324436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d34a1a6f-d664-4fa4-9174-3648e7a51355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:22.332554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1160/2342] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:22.353952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:22.366359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5604-250f-4f29-b0f0-1b2ebc1fbd4a service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:22.372151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:22.372764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:22.373049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:22.373328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:22.382268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:22.383945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:22.396050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1183/2343] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:30.943396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a1a6f-d664-4fa4-9174-3648e7a51355 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:30.949875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=19 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:30.955325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a1a6f-d664-4fa4-9174-3648e7a51355 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:30.958955 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4df22e-6a94-46ff-8ff2-f67308b64321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:30.959584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df22e-6a94-46ff-8ff2-f67308b64321 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:30.960158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df22e-6a94-46ff-8ff2-f67308b64321 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:30.960497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df22e-6a94-46ff-8ff2-f67308b64321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:30.962345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ac4df22e-6a94-46ff-8ff2-f67308b64321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:30.976004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4df22e-6a94-46ff-8ff2-f67308b64321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:30.978067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4df22e-6a94-46ff-8ff2-f67308b64321 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:30.989328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1161/2344] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:32.391162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:33.457101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:33.467078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b09418-5f81-4053-80f6-0c6881160d5e service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:33.471123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:33.471774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:33.472062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:33.472394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:33.474372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:33.488755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:33.490344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:33.502040 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1184/2345] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:41.156042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:43.496875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=6 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:45.294722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657450d-b523-4fa9-a2c7-b57de94f9c97 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:45.295194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657450d-b523-4fa9-a2c7-b57de94f9c97 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:45.295307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657450d-b523-4fa9-a2c7-b57de94f9c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:45.315354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7657450d-b523-4fa9-a2c7-b57de94f9c97 None None] MFA Rules not processed for user `9da7be15ac034bc6abfad286614e4262`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:45.316504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7657450d-b523-4fa9-a2c7-b57de94f9c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:45.325055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1162/2346] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:03:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:46.896945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:46.898483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:46.909666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a976e-2cd0-472d-bd26-a9e207458e64 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:46.913973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305549a9-ea74-4c9b-9dcf-99f9d6dcdd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:46.914585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305549a9-ea74-4c9b-9dcf-99f9d6dcdd3d service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:46.914870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305549a9-ea74-4c9b-9dcf-99f9d6dcdd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:46.915144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305549a9-ea74-4c9b-9dcf-99f9d6dcdd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:46.916922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-305549a9-ea74-4c9b-9dcf-99f9d6dcdd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:46.928491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305549a9-ea74-4c9b-9dcf-99f9d6dcdd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:46.930673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305549a9-ea74-4c9b-9dcf-99f9d6dcdd3d service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:46.947768 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1185/2347] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:47.575163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657450d-b523-4fa9-a2c7-b57de94f9c97 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:47.586718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657450d-b523-4fa9-a2c7-b57de94f9c97 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:47.590771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:47.595142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:47.595142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:47.595142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:47.595142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:47.608107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:47.610018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:47.623980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1163/2348] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:48.416750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49b90-a721-4a32-8dcf-2bfee62ff9fd None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:48.417227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49b90-a721-4a32-8dcf-2bfee62ff9fd None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:48.417320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49b90-a721-4a32-8dcf-2bfee62ff9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:48.439103 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b7e49b90-a721-4a32-8dcf-2bfee62ff9fd None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:48.440329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b7e49b90-a721-4a32-8dcf-2bfee62ff9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:48.514849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1186/2349] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 1 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:03:48.758403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:48.765101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:48.884688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e997bf-560b-4a66-bfc9-133716839757 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:48.895602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:48.896764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:48.897364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:48.898358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:48.909409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:48.911604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:48.923965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1164/2350] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:03:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:03:53.775274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:53.777370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:53.777370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:53.796308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] MFA Rules not processed for user `2c1113cbce924ad9b68690db65c58232`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:03:53.797594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:53.805897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1187/2351] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:03:54.253316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:54.263174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7c0c-f585-4398-8b49-7ef5ae171f05 service swift] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:54.267396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:54.267861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:54.268498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:54.269021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:54.271660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:54.286869 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:54.288665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:54.301708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1165/2352] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:55.187495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:55.192464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:55.346690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef059-52bc-4991-a331-fed3a17851b8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:55.352614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:55.353504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:55.354107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:55.354534 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:55.356572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:55.370108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:55.372530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:55.402189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1188/2353] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:59.462843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:59.480829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c66ea-f3c7-4341-bf1d-c300088dead0 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:59.488433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:59.489726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:59.490188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:59.490627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:59.494139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:59.507198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:59.509348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:59.526391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1166/2354] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:59.656452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:59.667297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815251-a05b-4550-a4ab-600fa9105b44 service placement] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:59.676746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:59.678279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:59.678569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:59.678849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:59.681553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:59.693325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:59.695097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:59.707674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1189/2355] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:03:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:02.521213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:02.527175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:02.538706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c636b-2805-4b5e-bec3-776eb64740df service nova] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:02.543841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:02.544500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:02.544786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:02.545069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] PATH_INFO: `/v3/users/8aaabcf6ef144ff98e700f2f031ff3b5` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:02.546342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aaabcf6ef144ff98e700f2f031ff3b5)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:02.548953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:02.818160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aaabcf6ef144ff98e700f2f031ff3b5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:02.833099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aaabcf6ef144ff98e700f2f031ff3b5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:02.963972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aaabcf6ef144ff98e700f2f031ff3b5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:02.965918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aaabcf6ef144ff98e700f2f031ff3b5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:02.983249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aaabcf6ef144ff98e700f2f031ff3b5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:02.996357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1167/2356] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:04:02 2022] DELETE /identity/v3/users/8aaabcf6ef144ff98e700f2f031ff3b5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:03.298682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:03.313578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e822e1-e053-49c6-9385-7354eee64d15 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:03.391179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:03.391991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:03.392498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:03.392848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] PATH_INFO: `/v3/projects/a95d82f4043d47d4ab1a2e01bcda3ca7` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:03.394226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95d82f4043d47d4ab1a2e01bcda3ca7)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:03.396224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:03.399411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:03.666809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95d82f4043d47d4ab1a2e01bcda3ca7', 'request_id': 'req-64fc8788-315d-407a-bf1b-bc626c984b2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:03.673167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95d82f4043d47d4ab1a2e01bcda3ca7', 'request_id': 'req-64fc8788-315d-407a-bf1b-bc626c984b2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:03.844825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95d82f4043d47d4ab1a2e01bcda3ca7', 'request_id': 'req-64fc8788-315d-407a-bf1b-bc626c984b2e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:03.857497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] The token cache is being invalidate because project a95d82f4043d47d4ab1a2e01bcda3ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:04:03.857824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:03.858480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:03.860083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1190/2357] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:04:03 2022] DELETE /identity/v3/projects/a95d82f4043d47d4ab1a2e01bcda3ca7 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:03.864316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:03.865917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:03.879081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001232b4-77f3-4cc2-b5a5-05d53eb27ccd admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:03.891605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:03.939553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:03.940223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:03.940559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:03.940985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] PATH_INFO: `/v3/users/73e9a6800a9b43daa7bd98ffe13691df` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:03.942213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e9a6800a9b43daa7bd98ffe13691df)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:03.944374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:04.004657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:04.007083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:04.066947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc8788-315d-407a-bf1b-bc626c984b2e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:04.073046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:04.073745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:04.074030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:04.074305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:04.076099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:04.091460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:04.092942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:04.106286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1191/2358] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:04:04.180174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e9a6800a9b43daa7bd98ffe13691df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:04.188674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e9a6800a9b43daa7bd98ffe13691df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:04.309331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e9a6800a9b43daa7bd98ffe13691df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:04.311529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e9a6800a9b43daa7bd98ffe13691df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:04.327916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6ea4bbd6-211e-4031-a716-83c1ff086ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e9a6800a9b43daa7bd98ffe13691df'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:04.344082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1168/2359] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:04:03 2022] DELETE /identity/v3/users/73e9a6800a9b43daa7bd98ffe13691df => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:04.762639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:04.766350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:04.779779 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a94f-b7ab-4362-9eab-1bd5eb6779b9 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:04.855519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:04.856182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:04.856463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:04.856944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] PATH_INFO: `/v3/projects/796def07714f4cb89edff7821ad099a2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:04.858122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796def07714f4cb89edff7821ad099a2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:04.860109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:04.977838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:04.987242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796def07714f4cb89edff7821ad099a2', 'request_id': 'req-61f41b62-ae31-411b-919f-a472c487ba14'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:04.994443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796def07714f4cb89edff7821ad099a2', 'request_id': 'req-61f41b62-ae31-411b-919f-a472c487ba14'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:05.107266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796def07714f4cb89edff7821ad099a2', 'request_id': 'req-61f41b62-ae31-411b-919f-a472c487ba14'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:05.119005 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] The token cache is being invalidate because project 796def07714f4cb89edff7821ad099a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:04:05.119222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:05.119850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-61f41b62-ae31-411b-919f-a472c487ba14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:05.121402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1192/2360] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:04:04 2022] DELETE /identity/v3/projects/796def07714f4cb89edff7821ad099a2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:05.126694 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6452-a1be-48e9-873a-3bdf5b55c862 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.127197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6452-a1be-48e9-873a-3bdf5b55c862 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.127308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6452-a1be-48e9-873a-3bdf5b55c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.147492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-459e6452-a1be-48e9-873a-3bdf5b55c862 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:05.149283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-459e6452-a1be-48e9-873a-3bdf5b55c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:05.209742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1169/2361] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:05.219042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90d86-3bdd-4b0f-8b87-a83b904c3b2d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.219442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90d86-3bdd-4b0f-8b87-a83b904c3b2d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.219824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90d86-3bdd-4b0f-8b87-a83b904c3b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.240486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-f3b90d86-3bdd-4b0f-8b87-a83b904c3b2d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:05.241832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f3b90d86-3bdd-4b0f-8b87-a83b904c3b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:05.250277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1193/2362] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:05.256619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e6452-a1be-48e9-873a-3bdf5b55c862 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:05.267713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e6452-a1be-48e9-873a-3bdf5b55c862 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:05.273083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:05.279015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.279015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.279015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.279015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:04:05.279015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:05.279015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:05.291594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1170/2363] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:04:05.296118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90d86-3bdd-4b0f-8b87-a83b904c3b2d None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:05.306558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90d86-3bdd-4b0f-8b87-a83b904c3b2d None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:05.311383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:05.312096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.312700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.313045 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.313818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:05.315789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:05.527042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1194/2364] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:04:05 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:05.530666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:05.545406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53bdd-072e-486e-b028-53bc182be0b8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:05.624225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:05.624854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.625336 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.625834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.626496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:05.628664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:05.806858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1171/2365] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:04:05 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:05.808601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:05.822396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cd382-1b30-4f2d-9804-056bc98773e4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:05.827471 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:05.828106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.828391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.828860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.829752 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:05.831419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:05.843794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1195/2366] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:05.856411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:05.873979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629632d6-3b62-4c93-b712-4582957b878c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:05.882661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568271e6-9427-4a36-9ad2-77af49be7e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:05.886799 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568271e6-9427-4a36-9ad2-77af49be7e6d admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.887087 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568271e6-9427-4a36-9ad2-77af49be7e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.887367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568271e6-9427-4a36-9ad2-77af49be7e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.888086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568271e6-9427-4a36-9ad2-77af49be7e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:05.890450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568271e6-9427-4a36-9ad2-77af49be7e6d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:05.907307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1172/2367] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:05.911373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:05.923259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389619-a3b3-4988-9b45-e10a136e4351 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:05.930879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:05.932481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:05.932774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:05.933060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] PATH_INFO: `/v3/projects/496aa09ed41243d7beb61b96cf2675ba/users/8536a7207a6247f49008909b6f3ee858/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:05.950696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496aa09ed41243d7beb61b96cf2675ba, user_id=8536a7207a6247f49008909b6f3ee858, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:05.954175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:06.052416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1196/2368] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:04:05 2022] PUT /identity/v3/projects/496aa09ed41243d7beb61b96cf2675ba/users/8536a7207a6247f49008909b6f3ee858/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:06.057815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003de637-e34c-4a7a-87fb-3c73a2b64da8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:06.058148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003de637-e34c-4a7a-87fb-3c73a2b64da8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:06.058385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003de637-e34c-4a7a-87fb-3c73a2b64da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:06.092639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-003de637-e34c-4a7a-87fb-3c73a2b64da8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:06.094871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-003de637-e34c-4a7a-87fb-3c73a2b64da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:06.167290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1173/2369] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:06.178014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:06.180382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:06.268990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece579ad-4ffe-4f8a-88a8-b4f8296989e0 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:06.273469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:06.274177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:06.274504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:06.275275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:06.285800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:06.287413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:06.298287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1197/2370] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:06.631181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:07.932261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4490b88-ce84-4e75-9e15-8953db0fc5bd None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:07.933334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4490b88-ce84-4e75-9e15-8953db0fc5bd None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:07.933918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4490b88-ce84-4e75-9e15-8953db0fc5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:07.963541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b4490b88-ce84-4e75-9e15-8953db0fc5bd None None] MFA Rules not processed for user `6a4cc8dc12fe459cb46bd1ea5ce42f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:07.965507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b4490b88-ce84-4e75-9e15-8953db0fc5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:08.072723 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1174/2371] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:08.863654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:08.874835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d13d-d6c5-4a6a-b0b1-5284faf4bd68 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:08.878941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:08.879915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:08.880421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:08.880797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:08.893942 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:08.917571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:08.919174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:08.933131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1198/2372] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:10.501553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:10.506148 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:10.506476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:10.544321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:10.546152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:10.567890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1175/2373] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:10.589436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:10.592800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:10.717905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:10.751948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18548d0-019d-498d-8bb2-71612961d764 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:10.761989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:10.762936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:10.763368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:10.763826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:10.806447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:10.808154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:10.833853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1199/2374] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:11.420141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:11.422813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:11.444295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03468-46bb-4270-9d13-0dde521c5584 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:11.456227 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:11.457048 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:11.457432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:11.457755 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] PATH_INFO: `/v3/users/1f30bfa8b6e2449493810c05754bf8c1` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:11.459062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f30bfa8b6e2449493810c05754bf8c1)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:11.461226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:12.072417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:12.088194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f30bfa8b6e2449493810c05754bf8c1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:12.097673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f30bfa8b6e2449493810c05754bf8c1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:12.228113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f30bfa8b6e2449493810c05754bf8c1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:12.229029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f30bfa8b6e2449493810c05754bf8c1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:12.252313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-b31d009f-e15b-48e2-9785-476013e47f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f30bfa8b6e2449493810c05754bf8c1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:12.269700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1176/2375] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:04:11 2022] DELETE /identity/v3/users/1f30bfa8b6e2449493810c05754bf8c1 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:12.670428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:12.701441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8982aa3-239c-4ab8-86ff-dc4133faf647 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:12.840025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:12.840874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:12.841235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:12.841760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] PATH_INFO: `/v3/projects/608811334b384e299084e12b27b50f04` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:12.843354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608811334b384e299084e12b27b50f04)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:12.845662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:13.084598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608811334b384e299084e12b27b50f04', 'request_id': 'req-a6359efa-d615-490d-bdbb-d1fe92c61766'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:13.095647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608811334b384e299084e12b27b50f04', 'request_id': 'req-a6359efa-d615-490d-bdbb-d1fe92c61766'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:13.244985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608811334b384e299084e12b27b50f04', 'request_id': 'req-a6359efa-d615-490d-bdbb-d1fe92c61766'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:13.258637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] The token cache is being invalidate because project 608811334b384e299084e12b27b50f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:04:13.259027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:13.259690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a6359efa-d615-490d-bdbb-d1fe92c61766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:13.264854 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1200/2376] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:04:12 2022] DELETE /identity/v3/projects/608811334b384e299084e12b27b50f04 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:13.266426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4005-3ef5-4e08-aca5-98f4babd31fd None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:13.266910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4005-3ef5-4e08-aca5-98f4babd31fd None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:13.267113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4005-3ef5-4e08-aca5-98f4babd31fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:13.288445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-69ec4005-3ef5-4e08-aca5-98f4babd31fd None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:13.291023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-69ec4005-3ef5-4e08-aca5-98f4babd31fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:13.382533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1177/2377] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:13.390528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300b466-6409-4141-a94e-b035f3eca054 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:13.395254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300b466-6409-4141-a94e-b035f3eca054 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:13.395254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300b466-6409-4141-a94e-b035f3eca054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:13.431297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4300b466-6409-4141-a94e-b035f3eca054 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:13.433124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4300b466-6409-4141-a94e-b035f3eca054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:13.447206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec4005-3ef5-4e08-aca5-98f4babd31fd None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:13.448097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1201/2378] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:13.459385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec4005-3ef5-4e08-aca5-98f4babd31fd None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:13.472224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:13.472971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:13.473392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:13.473700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:13.474510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:04:13.474779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:13.482340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:13.499793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1178/2379] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:04:13.504657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300b466-6409-4141-a94e-b035f3eca054 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:13.518407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300b466-6409-4141-a94e-b035f3eca054 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:13.526278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:13.526939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:13.527227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:13.527512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:13.528248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:13.530525 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:13.658404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1202/2380] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:04:13 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:13.659677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:13.680386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f77cd-8902-423b-9d2f-da53f1c8a6a2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:13.770916 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:13.774111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:13.774111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:13.774111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:13.776051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:13.778354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:13.909553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1179/2381] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:04:13 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:04:13.915082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:13.930457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53e0a8-c743-4777-9a7d-b19ce777b9f6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:13.937544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:13.938658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:13.939330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:13.939825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:13.943499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:13.945431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:13.957322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1203/2382] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:04:13.960989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:13.974207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e35f0c-c4e2-4222-b39d-c0824582a0df admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:13.985399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776aea0-8548-4be0-9919-b142c1687bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:13.986075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776aea0-8548-4be0-9919-b142c1687bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:13.986612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776aea0-8548-4be0-9919-b142c1687bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:13.987101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776aea0-8548-4be0-9919-b142c1687bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:13.987968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776aea0-8548-4be0-9919-b142c1687bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:13.989642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776aea0-8548-4be0-9919-b142c1687bb8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:14.011241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1180/2383] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:14.017972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:14.042236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c961f-57cc-4731-9030-7fb926f33f74 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:14.048291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:14.048984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:14.049374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:14.049694 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] PATH_INFO: `/v3/projects/b7c0d97f325442c99f30cae8d538bbca/users/448d4302bfac48fda73b43af59596d3e/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:14.100757 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0d97f325442c99f30cae8d538bbca, user_id=448d4302bfac48fda73b43af59596d3e, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:14.109237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:14.213905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1204/2384] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:04:14 2022] PUT /identity/v3/projects/b7c0d97f325442c99f30cae8d538bbca/users/448d4302bfac48fda73b43af59596d3e/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:14.214009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426726c-fedb-4645-8d53-ac2129893d85 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:14.214009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426726c-fedb-4645-8d53-ac2129893d85 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:14.214009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426726c-fedb-4645-8d53-ac2129893d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:14.248568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a426726c-fedb-4645-8d53-ac2129893d85 None None] MFA Rules not processed for user `448d4302bfac48fda73b43af59596d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:14.250805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a426726c-fedb-4645-8d53-ac2129893d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:14.448487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1181/2385] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:14.459530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:14.462300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:14.638165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74435-d5ab-4b3b-bf81-255afc39e192 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:14.661316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:14.662047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:14.662293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:14.662627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:14.673764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:14.675656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:14.703145 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1205/2386] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:14.939222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:15.475200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b1b1-0c01-402d-88b3-ad0adcacbb51 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:15.475797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b1b1-0c01-402d-88b3-ad0adcacbb51 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:15.475797 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b1b1-0c01-402d-88b3-ad0adcacbb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:15.520089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-be69b1b1-0c01-402d-88b3-ad0adcacbb51 None None] MFA Rules not processed for user `8536a7207a6247f49008909b6f3ee858`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:15.521320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-be69b1b1-0c01-402d-88b3-ad0adcacbb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:15.604862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1182/2387] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:04:15.614341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:15.616394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:15.719062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868dc45-50af-4bf8-9dc5-8faf1aaaac95 service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:15.756526 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:15.758447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:15.759131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:15.760392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:15.762716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:15.776186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:15.904979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:15.997350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1206/2388] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:04:15 2022] POST /identity/v3/projects => generated 369 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:16.005343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b1b1-0c01-402d-88b3-ad0adcacbb51 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:16.053253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b1b1-0c01-402d-88b3-ad0adcacbb51 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:16.194339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:16.195213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:16.195788 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:16.196510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:16.197746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:16.199351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:16.294051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1183/2389] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:04:16 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:16.298362 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:16.319594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e48e7-6b04-48ab-892b-33e8962529d5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:16.325821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:16.326697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:16.326865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:16.327170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:16.327941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:16.329996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:16.350200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1207/2390] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:16.352118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:16.378669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954b90-dbf4-4a1a-9d0f-db1df975abcd admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:16.393984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cc2e9-0e36-4c67-a9da-a865c76c070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:16.394738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc2e9-0e36-4c67-a9da-a865c76c070e admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:16.395022 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc2e9-0e36-4c67-a9da-a865c76c070e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:16.395303 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc2e9-0e36-4c67-a9da-a865c76c070e admin admin] PATH_INFO: `/v3/projects/66c752ca630f4edc8f3e166f20d8bc41/users/38f5b76f04fe46788ce5a0b106a994e9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:16.434329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cc2e9-0e36-4c67-a9da-a865c76c070e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c752ca630f4edc8f3e166f20d8bc41, user_id=38f5b76f04fe46788ce5a0b106a994e9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:16.437113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cc2e9-0e36-4c67-a9da-a865c76c070e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:16.623703 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1184/2391] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:04:16 2022] PUT /identity/v3/projects/66c752ca630f4edc8f3e166f20d8bc41/users/38f5b76f04fe46788ce5a0b106a994e9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:16.631424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:16.672705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1797d0-8168-4309-8098-1fa73c48e067 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:16.761664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:16.762286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:16.762744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:16.803126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:16.808714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:16.830864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:16.834864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:16.834864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:16.834864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:16.837732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:16.843787 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:16.880322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1208/2392] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:16.886314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:16.909031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ad44c-c6b0-43db-855a-63a112746c51 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:16.923572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:16.924676 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:16.926451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:16.927004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] PATH_INFO: `/v3/projects/66c752ca630f4edc8f3e166f20d8bc41/users/38f5b76f04fe46788ce5a0b106a994e9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:16.932171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c752ca630f4edc8f3e166f20d8bc41, user_id=38f5b76f04fe46788ce5a0b106a994e9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:16.935338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:16.940847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1185/2393] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:16.957657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:16.958285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1209/2394] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:04:16 2022] PUT /identity/v3/projects/66c752ca630f4edc8f3e166f20d8bc41/users/38f5b76f04fe46788ce5a0b106a994e9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:16.959338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:17.131617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d314eb-3ab2-4077-9ccc-d8b08597a5d1 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:17.289195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f427-ef94-4a97-9197-60a47f262cf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:17.290334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f427-ef94-4a97-9197-60a47f262cf3 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:17.290946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f427-ef94-4a97-9197-60a47f262cf3 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:17.291363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f427-ef94-4a97-9197-60a47f262cf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:17.378166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:17.399962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226303a0-8dc8-42dd-9c6b-4270f0753b83 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:17.407008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f427-ef94-4a97-9197-60a47f262cf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:17.410570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f427-ef94-4a97-9197-60a47f262cf3 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:17.413938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:17.414743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:17.415029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:17.425941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:17.425941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:17.430435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1186/2395] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:17.471350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:17.474259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:17.490033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1210/2396] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:18.526422 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d78c0-7b45-4ee4-bfa8-426f0aff1715 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:18.528069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d78c0-7b45-4ee4-bfa8-426f0aff1715 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:18.528492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d78c0-7b45-4ee4-bfa8-426f0aff1715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:18.566587 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ee2d78c0-7b45-4ee4-bfa8-426f0aff1715 None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:18.574110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ee2d78c0-7b45-4ee4-bfa8-426f0aff1715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:18.673706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1187/2397] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:04:18.696645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:18.703610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:18.908481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388a42-8c62-4034-b169-84b8e090108a service nova] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:18.928539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:18.930902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:18.932330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:18.933123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:18.964126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:18.970776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:18.977670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d78c0-7b45-4ee4-bfa8-426f0aff1715 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:19.013358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1211/2398] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:04:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:04:19.017499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d78c0-7b45-4ee4-bfa8-426f0aff1715 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:19.028070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913560a-bfc0-4c4c-b9ba-50a97c1369cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:19.035249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913560a-bfc0-4c4c-b9ba-50a97c1369cd service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:19.035249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913560a-bfc0-4c4c-b9ba-50a97c1369cd service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:19.035249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913560a-bfc0-4c4c-b9ba-50a97c1369cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:19.035778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f913560a-bfc0-4c4c-b9ba-50a97c1369cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:19.053863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913560a-bfc0-4c4c-b9ba-50a97c1369cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:19.072654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913560a-bfc0-4c4c-b9ba-50a97c1369cd service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:19.127371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1188/2399] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:19.399553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:19.426698 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:19.456376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee822b1-67da-438a-8ddb-58f42c807b56 service swift] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:19.472829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:19.474508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:19.477538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:19.478068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] PATH_INFO: `/v3/users/448d4302bfac48fda73b43af59596d3e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:19.483770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448d4302bfac48fda73b43af59596d3e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:19.487265 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:20.078574 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448d4302bfac48fda73b43af59596d3e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:20.081985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448d4302bfac48fda73b43af59596d3e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:20.087935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448d4302bfac48fda73b43af59596d3e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:20.118584 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448d4302bfac48fda73b43af59596d3e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:20.188514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-48e9b5c0-7962-42f6-9ee7-fd6f7f32dc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448d4302bfac48fda73b43af59596d3e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:20.330618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1212/2400] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:04:19 2022] DELETE /identity/v3/users/448d4302bfac48fda73b43af59596d3e => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:20.332376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:20.333346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:20.333692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:20.404631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:20.406282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:20.418064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:20.520990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:20.521280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:20.521595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:20.604551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1189/2401] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:20.608996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:20.616526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:20.618428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:20.622635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:20.643842 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1213/2402] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:04:20.665353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:20.667062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:20.751803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708071ee-db91-4e27-bfa3-57317467f649 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:20.772470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:20.772470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:20.772470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:20.772470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:20.816307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:20.823501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:20.864866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8f83d-e84c-433d-bce6-85e31e894fc0 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:20.865552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1190/2403] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:20.872819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc57c9-7947-4c79-afd2-c4c585e17717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:20.873741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc57c9-7947-4c79-afd2-c4c585e17717 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:20.874372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc57c9-7947-4c79-afd2-c4c585e17717 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:20.874935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc57c9-7947-4c79-afd2-c4c585e17717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:20.888773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc57c9-7947-4c79-afd2-c4c585e17717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:20.891338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc57c9-7947-4c79-afd2-c4c585e17717 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:20.908010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1214/2404] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:22.128294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:22.830606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:22.836237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:22.851219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:22.969594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf8e5-6996-4f7b-8338-bf84c9475065 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:22.982250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:22.983386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:22.983851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:22.984305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] PATH_INFO: `/v3/projects/b7c0d97f325442c99f30cae8d538bbca` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:22.986324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c0d97f325442c99f30cae8d538bbca)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:22.992146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:23.219977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c0d97f325442c99f30cae8d538bbca', 'request_id': 'req-013a7483-578b-4fcf-9f3e-96fd5cb0378b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:23.263939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c0d97f325442c99f30cae8d538bbca', 'request_id': 'req-013a7483-578b-4fcf-9f3e-96fd5cb0378b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:23.355333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c0d97f325442c99f30cae8d538bbca', 'request_id': 'req-013a7483-578b-4fcf-9f3e-96fd5cb0378b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:23.378357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] The token cache is being invalidate because project b7c0d97f325442c99f30cae8d538bbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:04:23.378357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:23.390020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-013a7483-578b-4fcf-9f3e-96fd5cb0378b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:04:23.395486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1191/2405] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:04:22 2022] DELETE /identity/v3/projects/b7c0d97f325442c99f30cae8d538bbca => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:23.397231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86b03e-ff7e-4210-89f5-5b33a1a23948 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:23.400488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86b03e-ff7e-4210-89f5-5b33a1a23948 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:23.400488 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86b03e-ff7e-4210-89f5-5b33a1a23948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:23.438182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0d86b03e-ff7e-4210-89f5-5b33a1a23948 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:23.439490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0d86b03e-ff7e-4210-89f5-5b33a1a23948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:23.576380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1215/2406] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:23.579106 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde13f8-a666-437c-90ec-2359710a4a76 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:23.579532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde13f8-a666-437c-90ec-2359710a4a76 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:23.579909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde13f8-a666-437c-90ec-2359710a4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:23.618210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dfde13f8-a666-437c-90ec-2359710a4a76 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:23.620232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dfde13f8-a666-437c-90ec-2359710a4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:23.646990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86b03e-ff7e-4210-89f5-5b33a1a23948 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:23.658575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1192/2407] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:23.669991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86b03e-ff7e-4210-89f5-5b33a1a23948 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:23.684922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:23.699327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:23.701314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:23.702049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:23.706957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:04:23.709199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:23.713544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:23.743197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1216/2408] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:04:23.747905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde13f8-a666-437c-90ec-2359710a4a76 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:23.765324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde13f8-a666-437c-90ec-2359710a4a76 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:23.779502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:23.780909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:23.781294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:23.781832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:23.782764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:23.784911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:23.905376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:23.905971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:23.906678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1193/2409] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:04:23 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:23.934932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200d99a-5f70-4052-976b-b60df13a67f3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:24.068242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:24.069352 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:24.070358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:24.070822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:24.071708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:24.077815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:24.323896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1217/2410] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:04:23 2022] POST /identity/v3/users => generated 286 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:04:24.341769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:24.367699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc007228-3820-41d6-b095-6c60c46bd00d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:24.383816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:24.386554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:24.387392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:24.388163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:24.389837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:24.394998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:24.420059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1194/2411] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:24.424630 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:24.445372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3fdbf-f219-4228-98a4-9ca90756beef admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:24.462628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac28f2-6910-4826-9aa0-c90660497f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:24.466320 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac28f2-6910-4826-9aa0-c90660497f91 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:24.470093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac28f2-6910-4826-9aa0-c90660497f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:24.470679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac28f2-6910-4826-9aa0-c90660497f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:24.474404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac28f2-6910-4826-9aa0-c90660497f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:24.480421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac28f2-6910-4826-9aa0-c90660497f91 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:24.526134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:24.530200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1218/2412] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:24.542137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a57fa-ec90-4399-befd-fd41cd6a4b7b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:24.548335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0be16-cec3-4689-b062-40e31ff14f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:24.551044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0be16-cec3-4689-b062-40e31ff14f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:24.551499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0be16-cec3-4689-b062-40e31ff14f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:24.551892 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0be16-cec3-4689-b062-40e31ff14f92 admin admin] PATH_INFO: `/v3/projects/5cc6488406a24596879d2c17b96e8e36/users/ba99bb86c4184ba492e3dcdd9fff902d/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:24.596893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0be16-cec3-4689-b062-40e31ff14f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc6488406a24596879d2c17b96e8e36, user_id=ba99bb86c4184ba492e3dcdd9fff902d, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:24.600085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0be16-cec3-4689-b062-40e31ff14f92 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:24.813322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1195/2413] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:04:24 2022] PUT /identity/v3/projects/5cc6488406a24596879d2c17b96e8e36/users/ba99bb86c4184ba492e3dcdd9fff902d/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:24.825404 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0926ef-31fa-49b7-ab78-798b4b367935 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:24.825895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0926ef-31fa-49b7-ab78-798b4b367935 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:24.826374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0926ef-31fa-49b7-ab78-798b4b367935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:24.911946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8d0926ef-31fa-49b7-ab78-798b4b367935 None None] MFA Rules not processed for user `ba99bb86c4184ba492e3dcdd9fff902d`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:24.923519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8d0926ef-31fa-49b7-ab78-798b4b367935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:25.208144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1219/2414] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:25.208284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:25.208284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:25.208284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:25.211333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0926ef-31fa-49b7-ab78-798b4b367935 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:25.231117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:25.232818 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:25.357782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0926ef-31fa-49b7-ab78-798b4b367935 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:25.382680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:25.385334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:25.385334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:25.385596 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:25.386457 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:25.392561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:25.411862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1196/2415] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:25.428253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:25.440559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:25.508260 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:25.564982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4182-c01c-4c29-8af0-4b9e0ca92141 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:25.585139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:25.585477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:25.585700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:25.586092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:25.597375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:25.599189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:25.609954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1197/2416] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:25.653371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:25.654984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:25.675204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860478-1283-46b2-9a79-8878880b5a23 service nova] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:25.684151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:25.685110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:25.685399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:25.685711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:25.688146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:25.712990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:25.715035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:25.734091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1198/2417] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:04:25.753056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1220/2418] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:04:25 2022] POST /identity/v3/projects => generated 371 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:25.754482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:25.769820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010488-d47f-48b3-ae02-7f5ec057ac41 service nova] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:25.865618 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:25.866254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:25.867111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:25.867388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:25.868063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:25.870276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:26.185102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1199/2419] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:04:25 2022] POST /identity/v3/users => generated 292 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:04:26.189139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:26.201889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6fa40-8fda-4bd0-9e91-7e88fa317905 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:26.206981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:26.207987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:26.208567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:26.209179 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:26.210233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:26.212580 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:26.228902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:26.239798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1221/2420] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:26.242153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee9b7e-cd9f-46e9-8382-eeed6a49e071 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:26.249330 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:26.250609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:26.251098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:26.251574 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] PATH_INFO: `/v3/projects/9b4df2d85d1f41f9a0012684375148d0/users/dd98e8f0b0ba4c789daa359e00bd0ed7/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:26.273798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4df2d85d1f41f9a0012684375148d0, user_id=dd98e8f0b0ba4c789daa359e00bd0ed7, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:26.278728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:26.425941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:26.426195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1200/2421] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:04:26 2022] PUT /identity/v3/projects/9b4df2d85d1f41f9a0012684375148d0/users/dd98e8f0b0ba4c789daa359e00bd0ed7/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:26.445144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:26.459105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fb108-8748-4191-ad15-2a36c9b6672b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:26.581239 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07818f-08ec-421b-9b93-04ed8cb44d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:26.582361 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07818f-08ec-421b-9b93-04ed8cb44d7e admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:26.582848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07818f-08ec-421b-9b93-04ed8cb44d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:26.583644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07818f-08ec-421b-9b93-04ed8cb44d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:26.584634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07818f-08ec-421b-9b93-04ed8cb44d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:26.587649 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07818f-08ec-421b-9b93-04ed8cb44d7e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:26.611828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1222/2422] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:04:26.615223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:26.637816 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadd61-3767-45a3-8d93-488dd4791fa3 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:26.643846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:26.644843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:26.645262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:26.645726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] PATH_INFO: `/v3/projects/9b4df2d85d1f41f9a0012684375148d0/users/dd98e8f0b0ba4c789daa359e00bd0ed7/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:26.651716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4df2d85d1f41f9a0012684375148d0, user_id=dd98e8f0b0ba4c789daa359e00bd0ed7, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:26.655829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:26.671435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1201/2423] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:04:26 2022] PUT /identity/v3/projects/9b4df2d85d1f41f9a0012684375148d0/users/dd98e8f0b0ba4c789daa359e00bd0ed7/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:04:26.681784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f6d9-0bb5-4622-bb83-478129842322 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:26.682085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f6d9-0bb5-4622-bb83-478129842322 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:26.682354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f6d9-0bb5-4622-bb83-478129842322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:26.736690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-95a4f6d9-0bb5-4622-bb83-478129842322 None None] MFA Rules not processed for user `dd98e8f0b0ba4c789daa359e00bd0ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:26.737983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-95a4f6d9-0bb5-4622-bb83-478129842322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:26.897134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1223/2424] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:26.906549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:26.908680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:27.056218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dc2b6-7aa6-4c18-af57-0787f6709fb1 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:27.062159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf659-ef07-46b2-97fa-40c52085cfa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:27.063476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf659-ef07-46b2-97fa-40c52085cfa1 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:27.064665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf659-ef07-46b2-97fa-40c52085cfa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:27.065229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf659-ef07-46b2-97fa-40c52085cfa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:27.103796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf659-ef07-46b2-97fa-40c52085cfa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:27.105660 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf659-ef07-46b2-97fa-40c52085cfa1 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:27.118403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1202/2425] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:27.420635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f6d9-0bb5-4622-bb83-478129842322 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:27.436675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f6d9-0bb5-4622-bb83-478129842322 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:27.463978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbee4fa-93b4-4e32-8497-6b10fd032377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:27.464871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbee4fa-93b4-4e32-8497-6b10fd032377 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:27.465425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbee4fa-93b4-4e32-8497-6b10fd032377 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:27.465959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbee4fa-93b4-4e32-8497-6b10fd032377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:27.580102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbee4fa-93b4-4e32-8497-6b10fd032377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:27.581826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbee4fa-93b4-4e32-8497-6b10fd032377 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:27.607355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1224/2426] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:28.084665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:28.598885 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:29.566774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32901df-ab23-4be6-b010-154ccdd37286 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:29.566928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32901df-ab23-4be6-b010-154ccdd37286 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:29.567219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32901df-ab23-4be6-b010-154ccdd37286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:29.628648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f32901df-ab23-4be6-b010-154ccdd37286 None None] MFA Rules not processed for user `38f5b76f04fe46788ce5a0b106a994e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:29.630090 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f32901df-ab23-4be6-b010-154ccdd37286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:29.754430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb976-84d4-43f4-990a-a1c16b626249 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:29.755324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb976-84d4-43f4-990a-a1c16b626249 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:29.755754 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb976-84d4-43f4-990a-a1c16b626249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:29.797613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1203/2427] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:29.800666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-075fb976-84d4-43f4-990a-a1c16b626249 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:29.801992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-075fb976-84d4-43f4-990a-a1c16b626249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:29.925289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1225/2428] 10.222.0.57 () {58 vars in 1016 bytes} [Mon Aug 1 16:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:04:30.162831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32901df-ab23-4be6-b010-154ccdd37286 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:30.177422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb976-84d4-43f4-990a-a1c16b626249 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:30.260753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:30.353259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb976-84d4-43f4-990a-a1c16b626249 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:30.361025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32901df-ab23-4be6-b010-154ccdd37286 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:30.364107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44196e89-8c13-45ab-8632-88c08f45aaa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:30.367422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196e89-8c13-45ab-8632-88c08f45aaa3 service nova] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:30.370120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196e89-8c13-45ab-8632-88c08f45aaa3 service nova] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:30.370523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196e89-8c13-45ab-8632-88c08f45aaa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:30.372220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14be32-3d4e-4db6-b882-7b676b79171d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:30.373203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14be32-3d4e-4db6-b882-7b676b79171d service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:30.373746 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14be32-3d4e-4db6-b882-7b676b79171d service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:30.374232 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14be32-3d4e-4db6-b882-7b676b79171d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:30.377317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3f14be32-3d4e-4db6-b882-7b676b79171d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:30.383603 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44196e89-8c13-45ab-8632-88c08f45aaa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:30.387266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44196e89-8c13-45ab-8632-88c08f45aaa3 service nova] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:30.403633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1226/2429] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:30.561136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14be32-3d4e-4db6-b882-7b676b79171d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:30.563239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14be32-3d4e-4db6-b882-7b676b79171d service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:30.591011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1204/2430] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:36.163353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5f2dd-1aa0-4e7e-9f2b-119dee5f093a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:36.164250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5f2dd-1aa0-4e7e-9f2b-119dee5f093a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:36.164691 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5f2dd-1aa0-4e7e-9f2b-119dee5f093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:36.205734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-96e5f2dd-1aa0-4e7e-9f2b-119dee5f093a None None] MFA Rules not processed for user `8536a7207a6247f49008909b6f3ee858`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:36.207723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-96e5f2dd-1aa0-4e7e-9f2b-119dee5f093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:36.247748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1227/2431] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:41.022030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:46.244532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=30 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:49.406354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6287e-06c5-4f8b-b4ab-3dd64d791acb None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:49.406354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6287e-06c5-4f8b-b4ab-3dd64d791acb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:49.406354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6287e-06c5-4f8b-b4ab-3dd64d791acb None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:49.406354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1205/2432] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 16:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 16:04:49.411674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf564192-6bc6-4cd8-911d-1c39c0ea69c2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:49.412301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf564192-6bc6-4cd8-911d-1c39c0ea69c2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:49.412456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf564192-6bc6-4cd8-911d-1c39c0ea69c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:49.463004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-cf564192-6bc6-4cd8-911d-1c39c0ea69c2 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:49.464353 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cf564192-6bc6-4cd8-911d-1c39c0ea69c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:49.514011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1228/2433] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:49.526729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6287e-06c5-4f8b-b4ab-3dd64d791acb None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:49.528815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8dc6287e-06c5-4f8b-b4ab-3dd64d791acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:49.595883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6287e-06c5-4f8b-b4ab-3dd64d791acb None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:49.600056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa08af-7ea5-4132-a335-d5ebbd4d829c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:49.600688 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa08af-7ea5-4132-a335-d5ebbd4d829c service glance] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:49.600979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa08af-7ea5-4132-a335-d5ebbd4d829c service glance] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:49.601236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa08af-7ea5-4132-a335-d5ebbd4d829c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:49.614425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa08af-7ea5-4132-a335-d5ebbd4d829c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:49.616572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa08af-7ea5-4132-a335-d5ebbd4d829c service glance] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:49.628968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1206/2434] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:49.860781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0610-f540-4d40-bb39-654d71f8ad19 None None] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:49.860781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0610-f540-4d40-bb39-654d71f8ad19 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:49.861052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0610-f540-4d40-bb39-654d71f8ad19 None None] PATH_INFO: `/` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:49.862285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1229/2435] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 16:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 16:04:49.868568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e739b-782b-4255-a6d9-957166f8d4c0 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:49.868860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e739b-782b-4255-a6d9-957166f8d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:49.869137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e739b-782b-4255-a6d9-957166f8d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:49.909945 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d62e739b-782b-4255-a6d9-957166f8d4c0 None None] MFA Rules not processed for user `90399c6cab2341f1af74d154c819bff9`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:49.911590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d62e739b-782b-4255-a6d9-957166f8d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:49.988606 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1207/2436] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:50.002770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0610-f540-4d40-bb39-654d71f8ad19 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:50.004793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f05b0610-f540-4d40-bb39-654d71f8ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:50.033045 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0610-f540-4d40-bb39-654d71f8ad19 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:50.037849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2e472-cda8-459c-aa5a-7ffb726c6700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:50.038477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e472-cda8-459c-aa5a-7ffb726c6700 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:50.039195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e472-cda8-459c-aa5a-7ffb726c6700 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:50.039473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e472-cda8-459c-aa5a-7ffb726c6700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:50.054985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2e472-cda8-459c-aa5a-7ffb726c6700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:50.057193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2e472-cda8-459c-aa5a-7ffb726c6700 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:50.071089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1230/2437] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:50.168392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195d4f-9cad-4d23-a6fe-0daff8b46749 None None] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:50.169450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195d4f-9cad-4d23-a6fe-0daff8b46749 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:50.169450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195d4f-9cad-4d23-a6fe-0daff8b46749 None None] PATH_INFO: `/` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:50.170492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1208/2438] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 1 16:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 16:04:50.175743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccad7c-e6e5-4f33-ae20-d38cd13f2269 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:50.176224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccad7c-e6e5-4f33-ae20-d38cd13f2269 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:50.176654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccad7c-e6e5-4f33-ae20-d38cd13f2269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:50.199054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e8ccad7c-e6e5-4f33-ae20-d38cd13f2269 None None] MFA Rules not processed for user `784ac400fc5643a589d79d0314ee4a19`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:50.201570 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e8ccad7c-e6e5-4f33-ae20-d38cd13f2269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:50.209866 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1231/2439] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 1 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:50.220908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8195d4f-9cad-4d23-a6fe-0daff8b46749 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:50.232883 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8195d4f-9cad-4d23-a6fe-0daff8b46749 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:50.236499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:50.237273 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:50.237599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:50.237880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:50.249249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:50.250837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:50.262042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1209/2440] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:04:52.976383 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51abd3-7cf2-41b4-bfbb-a3a151bf34e6 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:52.977815 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51abd3-7cf2-41b4-bfbb-a3a151bf34e6 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:52.978713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51abd3-7cf2-41b4-bfbb-a3a151bf34e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:53.006906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6f51abd3-7cf2-41b4-bfbb-a3a151bf34e6 None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:04:53.008257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6f51abd3-7cf2-41b4-bfbb-a3a151bf34e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:53.076792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1232/2441] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:04:53.103833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:04:53.105557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:04:53.214124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428e78f-2133-4d6b-8c99-f41cbe6d7654 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:04:53.219514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:04:53.220322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:04:53.220752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:04:53.220942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:04:53.230040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:04:53.231720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:04:53.246033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1210/2442] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:04:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:05:03.068027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=55 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:03.244361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:08.697882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:08.698375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:08.698472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:08.719661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:08.720892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:08.730721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1233/2443] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 1 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:08.745036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:08.755931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cff515-95a1-4d94-9628-ef78212e9027 service swift] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:08.761063 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:08.761724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:08.762161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:08.762452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:08.771705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:08.773344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:08.781856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1211/2444] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:05:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:05:10.875227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:10.877375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:10.971315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dc0d9-68a4-4439-8994-41f466bfe03c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:10.976645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:10.977417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:10.977783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:10.978130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:10.980218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:10.994261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:10.996008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:11.009253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1234/2445] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:11.066963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:11.068525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:11.127739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd1564-0341-4cd7-9f93-6460d4de595f service swift] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:11.134343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:11.135150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:11.135522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:11.136117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] PATH_INFO: `/v3/users/9da7be15ac034bc6abfad286614e4262` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:11.137778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da7be15ac034bc6abfad286614e4262)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:11.139822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:11.467175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da7be15ac034bc6abfad286614e4262'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:11.474217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da7be15ac034bc6abfad286614e4262'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:11.563361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da7be15ac034bc6abfad286614e4262'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:11.564975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da7be15ac034bc6abfad286614e4262'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:11.588184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da7be15ac034bc6abfad286614e4262'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:11.598625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1212/2446] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:11 2022] DELETE /identity/v3/users/9da7be15ac034bc6abfad286614e4262 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:12.048508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:12.065961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bb45e-f494-4fbc-9685-7318508583d8 service placement] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:12.142605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:12.143660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:12.144011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:12.144359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] PATH_INFO: `/v3/projects/a9ce051b834143afa5159c5af3af6133` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:12.147270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ce051b834143afa5159c5af3af6133)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:12.149343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:12.295806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ce051b834143afa5159c5af3af6133', 'request_id': 'req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:12.303000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ce051b834143afa5159c5af3af6133', 'request_id': 'req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:12.394443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ce051b834143afa5159c5af3af6133', 'request_id': 'req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:12.409978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] The token cache is being invalidate because project a9ce051b834143afa5159c5af3af6133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:12.410305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:12.411227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:12.413468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1235/2447] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:12 2022] DELETE /identity/v3/projects/a9ce051b834143afa5159c5af3af6133 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:14.500811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:14.505987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:14.606505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb1ee4-fff0-417c-8828-fcea725b1615 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:14.634841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:14.676522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371a261-40a5-4589-84a9-129d13218a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:14.677157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a261-40a5-4589-84a9-129d13218a4b service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:14.677447 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a261-40a5-4589-84a9-129d13218a4b service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:14.677897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a261-40a5-4589-84a9-129d13218a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:14.679631 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3371a261-40a5-4589-84a9-129d13218a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:14.759782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371a261-40a5-4589-84a9-129d13218a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:14.762151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371a261-40a5-4589-84a9-129d13218a4b service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:14.775990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1213/2448] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:15.625669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:15.627082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:15.644044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:15.759078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb8ab-bcf9-49c6-808c-7cfc51ccd6df admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:15.765662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:15.766795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:15.767171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:15.767985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] PATH_INFO: `/v3/users/ba99bb86c4184ba492e3dcdd9fff902d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:15.769409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba99bb86c4184ba492e3dcdd9fff902d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:15.772894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:16.066442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba99bb86c4184ba492e3dcdd9fff902d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:16.067177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba99bb86c4184ba492e3dcdd9fff902d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:16.067852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba99bb86c4184ba492e3dcdd9fff902d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:16.079375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba99bb86c4184ba492e3dcdd9fff902d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:16.090516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba99bb86c4184ba492e3dcdd9fff902d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:16.188690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1236/2449] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:15 2022] DELETE /identity/v3/users/ba99bb86c4184ba492e3dcdd9fff902d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:16.194047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:16.194514 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:16.194630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:16.222790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:16.224127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:16.290974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1214/2450] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:05:16.305793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:16.308269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:16.400671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc19dc-1b62-4763-b12b-b1526be5430d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:16.404322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:16.406419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:16.406419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:16.406419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:16.416023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:16.417473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:16.438812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1237/2451] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:17.027289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:17.027458 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:17.046019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986a58-0c18-408f-8251-2439247d3967 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:17.052910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:17.056189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:17.056189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:17.056189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] PATH_INFO: `/v3/projects/5cc6488406a24596879d2c17b96e8e36` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:17.057682 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc6488406a24596879d2c17b96e8e36)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:17.059812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:17.107484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:17.109102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:17.121730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932456ef-4add-479d-b8a3-5bfd57a7bc4f service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:17.126364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:17.126981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:17.127260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:17.127536 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:17.129430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:17.175089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:17.205743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc6488406a24596879d2c17b96e8e36', 'request_id': 'req-4405c984-162d-4b0d-9785-fdaa5280e9e7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.212453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:17.215262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:17.215961 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc6488406a24596879d2c17b96e8e36', 'request_id': 'req-4405c984-162d-4b0d-9785-fdaa5280e9e7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.217105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:17.229042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1238/2452] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:17.360623 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc6488406a24596879d2c17b96e8e36', 'request_id': 'req-4405c984-162d-4b0d-9785-fdaa5280e9e7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.373204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] The token cache is being invalidate because project 5cc6488406a24596879d2c17b96e8e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:17.373495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.374181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.375726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1215/2453] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:17 2022] DELETE /identity/v3/projects/5cc6488406a24596879d2c17b96e8e36 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:17.379889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:17.392111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a4773-1bda-4ae9-8fcf-42078cd2c7f1 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:17.460897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:17.461615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:17.461907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:17.462182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] PATH_INFO: `/v3/users/dd98e8f0b0ba4c789daa359e00bd0ed7` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:17.463387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd98e8f0b0ba4c789daa359e00bd0ed7)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:17.465386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:17.782128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd98e8f0b0ba4c789daa359e00bd0ed7'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.782954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd98e8f0b0ba4c789daa359e00bd0ed7'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.783601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd98e8f0b0ba4c789daa359e00bd0ed7'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.791606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd98e8f0b0ba4c789daa359e00bd0ed7'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.805090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-75252b43-693a-42f1-844f-ef9e04c7dea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd98e8f0b0ba4c789daa359e00bd0ed7'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:17.964137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1239/2454] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:17 2022] DELETE /identity/v3/users/dd98e8f0b0ba4c789daa359e00bd0ed7 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:18.636480 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:18.638327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:18.656695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c984-162d-4b0d-9785-fdaa5280e9e7 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:18.725152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:18.725850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:18.726138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:18.726417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] PATH_INFO: `/v3/projects/9b4df2d85d1f41f9a0012684375148d0` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:18.727795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4df2d85d1f41f9a0012684375148d0)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:18.729767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:18.869024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4df2d85d1f41f9a0012684375148d0', 'request_id': 'req-31723a17-1a9b-4a0f-aeda-bca54cded83b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:18.876448 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4df2d85d1f41f9a0012684375148d0', 'request_id': 'req-31723a17-1a9b-4a0f-aeda-bca54cded83b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:18.980101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4df2d85d1f41f9a0012684375148d0', 'request_id': 'req-31723a17-1a9b-4a0f-aeda-bca54cded83b'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:18.993279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] The token cache is being invalidate because project 9b4df2d85d1f41f9a0012684375148d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:18.993607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:18.994256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-31723a17-1a9b-4a0f-aeda-bca54cded83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:18.995873 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1216/2455] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:18 2022] DELETE /identity/v3/projects/9b4df2d85d1f41f9a0012684375148d0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:19.001146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc3a0-aca3-4c2a-ac90-d6c0c7ea4e07 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.001693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc3a0-aca3-4c2a-ac90-d6c0c7ea4e07 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.002021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc3a0-aca3-4c2a-ac90-d6c0c7ea4e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.050264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a22cc3a0-aca3-4c2a-ac90-d6c0c7ea4e07 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:19.051535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a22cc3a0-aca3-4c2a-ac90-d6c0c7ea4e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:19.089821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:19.137503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1240/2456] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:19.140705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549386c5-892d-4b43-932b-0e76917790e9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.141241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549386c5-892d-4b43-932b-0e76917790e9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.143099 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549386c5-892d-4b43-932b-0e76917790e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.196054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-549386c5-892d-4b43-932b-0e76917790e9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:19.197290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-549386c5-892d-4b43-932b-0e76917790e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:19.205748 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1217/2457] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:19.210290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cc3a0-aca3-4c2a-ac90-d6c0c7ea4e07 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:19.220863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cc3a0-aca3-4c2a-ac90-d6c0c7ea4e07 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:19.226800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:19.227461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.227743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.228016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.228720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:19.229023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:19.230750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:19.244012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1241/2458] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:05:19.248571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549386c5-892d-4b43-932b-0e76917790e9 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:19.259160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549386c5-892d-4b43-932b-0e76917790e9 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:19.264544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:19.265278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.265572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.265843 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.270035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:19.270035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:19.406923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1218/2459] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:19 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:19.410987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:19.424959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d926-415b-42c0-adf9-4f9bce35c105 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:19.513911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:19.514543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.514826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.515104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.515791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:19.517795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:19.677896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1242/2460] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:19 2022] POST /identity/v3/users => generated 281 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:19.678769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:19.690114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee941-acd9-4d2c-ba30-d7d8d7ad85ff admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:19.695356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:19.695995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.696285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.699914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.699914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:19.699914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:19.710525 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1219/2461] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:19.715075 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:19.732146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1197-927b-437d-a450-60e352630a18 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:19.737147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3b955-b7be-497f-b503-b4d7f20b1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:19.737813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b955-b7be-497f-b503-b4d7f20b1337 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.738168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b955-b7be-497f-b503-b4d7f20b1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.738425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b955-b7be-497f-b503-b4d7f20b1337 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.739133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3b955-b7be-497f-b503-b4d7f20b1337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:19.741425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3b955-b7be-497f-b503-b4d7f20b1337 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:19.757548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1243/2462] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:19.759534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:19.771489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18b0d-516c-4b1a-bcdb-a906f4bcd3a2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:19.777136 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:19.777923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.778290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.778629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] PATH_INFO: `/v3/projects/0f531eaf26c84cf3a61e34f8114281b6/users/5d6d577d568d4632b93ac5f0b7abb3cb/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:19.797711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f531eaf26c84cf3a61e34f8114281b6, user_id=5d6d577d568d4632b93ac5f0b7abb3cb, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:19.800963 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:19.960535 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:19.972798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1220/2463] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:19 2022] PUT /identity/v3/projects/0f531eaf26c84cf3a61e34f8114281b6/users/5d6d577d568d4632b93ac5f0b7abb3cb/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:19.989765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ff26-8bc2-405d-b034-57570053189b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:19.993833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ff26-8bc2-405d-b034-57570053189b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:19.993833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ff26-8bc2-405d-b034-57570053189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:20.050173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-30d9ff26-8bc2-405d-b034-57570053189b None None] MFA Rules not processed for user `5d6d577d568d4632b93ac5f0b7abb3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:20.057851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-30d9ff26-8bc2-405d-b034-57570053189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:20.153339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1244/2464] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:20.163189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:20.306648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eca2a-2405-48dd-b230-fea42c0fe373 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:20.312736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:20.313485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:20.313922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:20.314289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:20.315213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:20.317580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:20.420374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1221/2465] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:20 2022] POST /identity/v3/projects => generated 363 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:20.424777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9ff26-8bc2-405d-b034-57570053189b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:20.442727 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9ff26-8bc2-405d-b034-57570053189b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:20.481438 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:20.546794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b215f-5697-4212-a152-257943890a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:20.546794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b215f-5697-4212-a152-257943890a3b admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:20.546794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b215f-5697-4212-a152-257943890a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:20.546794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b215f-5697-4212-a152-257943890a3b admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:20.547554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b215f-5697-4212-a152-257943890a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:20.552634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b215f-5697-4212-a152-257943890a3b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:20.717559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1245/2466] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:20 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:20.719066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:20.732370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8e8d-df6e-4f5e-9b0e-0bb8fd766b51 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:20.738503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:20.740065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:20.740517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:20.740997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:20.742068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:20.745846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:20.764931 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1222/2467] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:20.769402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b215f-5697-4212-a152-257943890a3b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:20.782780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b215f-5697-4212-a152-257943890a3b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:20.789227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:20.790002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:20.790291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:20.790746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] PATH_INFO: `/v3/projects/fa502b102f7a4f19a2195e52e8a6e62c/users/0d93efe565bc4bafa61c6349e3136eb0/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:20.807199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa502b102f7a4f19a2195e52e8a6e62c, user_id=0d93efe565bc4bafa61c6349e3136eb0, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:20.809959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:20.935329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1246/2468] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:20 2022] PUT /identity/v3/projects/fa502b102f7a4f19a2195e52e8a6e62c/users/0d93efe565bc4bafa61c6349e3136eb0/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:20.939760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:20.953279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287731a7-dea6-474c-8c10-07df094de1bb admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:21.034849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15217e12-4012-447d-a6df-e5191a7a724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:21.035763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217e12-4012-447d-a6df-e5191a7a724a admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:21.036237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217e12-4012-447d-a6df-e5191a7a724a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:21.036711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217e12-4012-447d-a6df-e5191a7a724a admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:21.037613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15217e12-4012-447d-a6df-e5191a7a724a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:21.039254 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15217e12-4012-447d-a6df-e5191a7a724a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:21.058178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:21.061593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1223/2469] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:21.072483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27055-f175-4a46-8218-349ceb6fdbb5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:21.079388 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:21.081272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:21.081955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:21.082719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] PATH_INFO: `/v3/projects/fa502b102f7a4f19a2195e52e8a6e62c/users/0d93efe565bc4bafa61c6349e3136eb0/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:21.086696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa502b102f7a4f19a2195e52e8a6e62c, user_id=0d93efe565bc4bafa61c6349e3136eb0, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:21.095822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:21.107164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1247/2470] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:21 2022] PUT /identity/v3/projects/fa502b102f7a4f19a2195e52e8a6e62c/users/0d93efe565bc4bafa61c6349e3136eb0/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:21.117355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef166-f171-4135-b5bb-49d8634e29bc None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:21.117690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef166-f171-4135-b5bb-49d8634e29bc None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:21.118244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef166-f171-4135-b5bb-49d8634e29bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:21.160012 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-8b3ef166-f171-4135-b5bb-49d8634e29bc None None] MFA Rules not processed for user `0d93efe565bc4bafa61c6349e3136eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:21.162049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-8b3ef166-f171-4135-b5bb-49d8634e29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:21.248858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:21.265326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1224/2471] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:21.274550 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:21.282636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:21.386639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343478b8-0e7c-4fd1-93e5-daebbfcf42ee admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:21.393283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:21.394367 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:21.395679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:21.395679 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:21.413326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:21.414855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:21.426632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1248/2472] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:22.819347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef166-f171-4135-b5bb-49d8634e29bc None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:22.888428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef166-f171-4135-b5bb-49d8634e29bc None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:22.893685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:22.894345 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:22.894826 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:22.895236 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] PATH_INFO: `/v3/users/5d6d577d568d4632b93ac5f0b7abb3cb` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:22.897002 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6d577d568d4632b93ac5f0b7abb3cb)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:22.900780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:22.911159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:22.914114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:22.975385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc845-0d92-497e-b139-91ba140ae36e service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:22.979472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f406f-1292-4d93-9f8d-a46452d25b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:22.980101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f406f-1292-4d93-9f8d-a46452d25b8b service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:22.980392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f406f-1292-4d93-9f8d-a46452d25b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:22.980673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f406f-1292-4d93-9f8d-a46452d25b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:22.982539 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-077f406f-1292-4d93-9f8d-a46452d25b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:22.995314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f406f-1292-4d93-9f8d-a46452d25b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:22.996986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f406f-1292-4d93-9f8d-a46452d25b8b service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:23.006808 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1249/2473] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:23.199552 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6d577d568d4632b93ac5f0b7abb3cb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:23.207809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6d577d568d4632b93ac5f0b7abb3cb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:23.293879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6d577d568d4632b93ac5f0b7abb3cb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:23.298044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6d577d568d4632b93ac5f0b7abb3cb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:23.315346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6d577d568d4632b93ac5f0b7abb3cb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:23.327619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1225/2474] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:22 2022] DELETE /identity/v3/users/5d6d577d568d4632b93ac5f0b7abb3cb => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:23.328977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:23.329888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:23.329888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:23.345097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:23.352609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:23.354315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:23.457702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1250/2475] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:05:23.468457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:23.469965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:23.545629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52715444-1049-4718-810e-6fd21e2bb280 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:23.549700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:23.550636 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:23.551126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:23.551364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:23.562036 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:23.563751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:23.577162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1226/2476] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:24.005819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:24.007657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:24.024915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ceef8-c6a0-44ab-8709-62ccfb4cc36d None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:24.031002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:24.032376 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:24.032696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:24.033101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] PATH_INFO: `/v3/projects/0f531eaf26c84cf3a61e34f8114281b6` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:24.035104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f531eaf26c84cf3a61e34f8114281b6)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:24.039009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:24.156858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f531eaf26c84cf3a61e34f8114281b6', 'request_id': 'req-98c0425a-8047-4a95-b930-eca55c86f892'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.164873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f531eaf26c84cf3a61e34f8114281b6', 'request_id': 'req-98c0425a-8047-4a95-b930-eca55c86f892'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.245695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f531eaf26c84cf3a61e34f8114281b6', 'request_id': 'req-98c0425a-8047-4a95-b930-eca55c86f892'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.258021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] The token cache is being invalidate because project 0f531eaf26c84cf3a61e34f8114281b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:24.258619 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.261837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.261837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1251/2477] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:24 2022] DELETE /identity/v3/projects/0f531eaf26c84cf3a61e34f8114281b6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:24.265026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:24.276275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312992c-55b2-466e-9df6-e99c1aab0a0a service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:24.293277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:24.346588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:24.347550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:24.347991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:24.348312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] PATH_INFO: `/v3/users/0d93efe565bc4bafa61c6349e3136eb0` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:24.350226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d93efe565bc4bafa61c6349e3136eb0)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:24.352240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:24.647595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d93efe565bc4bafa61c6349e3136eb0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.655549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d93efe565bc4bafa61c6349e3136eb0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.774676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d93efe565bc4bafa61c6349e3136eb0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.775312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d93efe565bc4bafa61c6349e3136eb0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.804904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e980a655-000d-4f86-8ac9-3f367b59a41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d93efe565bc4bafa61c6349e3136eb0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:24.812217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1227/2478] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:24 2022] DELETE /identity/v3/users/0d93efe565bc4bafa61c6349e3136eb0 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:25.363233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:25.367276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:25.384328 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0425a-8047-4a95-b930-eca55c86f892 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:25.494521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:25.495470 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:25.495914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:25.496366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] PATH_INFO: `/v3/projects/fa502b102f7a4f19a2195e52e8a6e62c` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:25.498256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa502b102f7a4f19a2195e52e8a6e62c)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:25.501655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:25.671799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:25.684412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa502b102f7a4f19a2195e52e8a6e62c', 'request_id': 'req-6f7b390c-cdeb-4e4f-986c-a3366d6202be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:25.691056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa502b102f7a4f19a2195e52e8a6e62c', 'request_id': 'req-6f7b390c-cdeb-4e4f-986c-a3366d6202be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:25.832814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa502b102f7a4f19a2195e52e8a6e62c', 'request_id': 'req-6f7b390c-cdeb-4e4f-986c-a3366d6202be'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:25.847413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] The token cache is being invalidate because project fa502b102f7a4f19a2195e52e8a6e62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:25.847413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:25.847413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6f7b390c-cdeb-4e4f-986c-a3366d6202be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:25.848089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1252/2479] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:25 2022] DELETE /identity/v3/projects/fa502b102f7a4f19a2195e52e8a6e62c => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:25.853733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec98f-b972-443b-b6aa-0b9cbe60dcfa None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:25.854718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec98f-b972-443b-b6aa-0b9cbe60dcfa None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:25.855004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec98f-b972-443b-b6aa-0b9cbe60dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:25.886990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c86ec98f-b972-443b-b6aa-0b9cbe60dcfa None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:25.888188 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c86ec98f-b972-443b-b6aa-0b9cbe60dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:25.957881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1228/2480] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:25.966908 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24a69-eb53-4815-8427-0040c50ec293 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:25.967354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24a69-eb53-4815-8427-0040c50ec293 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:25.967720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24a69-eb53-4815-8427-0040c50ec293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:25.991562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0ef24a69-eb53-4815-8427-0040c50ec293 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:25.992091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0ef24a69-eb53-4815-8427-0040c50ec293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:26.004544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1253/2481] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:26.005796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec98f-b972-443b-b6aa-0b9cbe60dcfa None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:26.016909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec98f-b972-443b-b6aa-0b9cbe60dcfa None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:26.022745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:26.023374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.023662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.025958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.025958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:26.025958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:26.026594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:26.040197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1229/2482] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:05:26.044594 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24a69-eb53-4815-8427-0040c50ec293 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:26.054636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24a69-eb53-4815-8427-0040c50ec293 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:26.059558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:26.060306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.060716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.060852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.061604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:26.063809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:26.223314 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1254/2483] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:26 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:26.228010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:26.245738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b854-19af-4ad4-83ce-1b1c7882a389 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:26.312323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:26.365978 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:26.366740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.367299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.367754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.368674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:26.371057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:26.490734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1230/2484] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:26 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:05:26.495031 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:26.507685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0b789-df5b-4d03-ba6f-54688c6e0c76 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:26.518982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:26.518982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.518982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.518982 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.519364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:26.519364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:26.529417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1255/2485] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:26.535120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:26.548241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b31cb-9dc1-4176-8dbf-f5bf51788ea2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:26.575429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be521-a488-43fd-a411-84648d2f76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:26.576255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be521-a488-43fd-a411-84648d2f76ac admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.576577 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be521-a488-43fd-a411-84648d2f76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.576859 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be521-a488-43fd-a411-84648d2f76ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.577617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be521-a488-43fd-a411-84648d2f76ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:26.579253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be521-a488-43fd-a411-84648d2f76ac admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:26.592137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1231/2486] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:26.596634 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:26.608828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec8be-cbd2-4b69-b7b9-e134d0fbc973 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:26.621316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:26.622725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.623490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.624119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] PATH_INFO: `/v3/projects/184bdec10d7046a183b1db8f3fa5f33b/users/6184df18287d41ca92d4676d9569f52b/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.649976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184bdec10d7046a183b1db8f3fa5f33b, user_id=6184df18287d41ca92d4676d9569f52b, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:26.652945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:26.757753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1256/2487] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:26 2022] PUT /identity/v3/projects/184bdec10d7046a183b1db8f3fa5f33b/users/6184df18287d41ca92d4676d9569f52b/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:26.769639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ccd22-333c-4af0-8419-e36c2983b951 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.770060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ccd22-333c-4af0-8419-e36c2983b951 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.770956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ccd22-333c-4af0-8419-e36c2983b951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.812079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-585ccd22-333c-4af0-8419-e36c2983b951 None None] MFA Rules not processed for user `6184df18287d41ca92d4676d9569f52b`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:26.814369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-585ccd22-333c-4af0-8419-e36c2983b951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:26.896510 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1232/2488] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:26.901009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:26.969036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7a11-8be4-4aea-9ee3-d667fc8aabd9 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:26.974970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:26.975644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:26.975930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:26.976206 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:26.976900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:26.978990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.152623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1257/2489] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:26 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:27.157200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ccd22-333c-4af0-8419-e36c2983b951 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.168557 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ccd22-333c-4af0-8419-e36c2983b951 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:27.235561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.237658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:27.241288 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:27.256034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.256336 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.256621 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.257325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:27.259956 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.327012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532008a-adb4-4713-b413-2a4722895c1b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:27.334819 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:27.335613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.335893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.336129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.338036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:27.352243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:27.359202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.369026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1258/2490] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:27.385937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1233/2491] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:27 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:27.389971 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.395424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.400940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:27.413110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d5a0-91ac-4116-b7bc-21845264708c service placement] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:27.415840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98537-4a99-43f8-9eaa-87944416112d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:27.418381 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:27.419235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.419519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.419795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.421227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:27.421776 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:27.427924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.427924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.427924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] PATH_INFO: `/v3/users/2c1113cbce924ad9b68690db65c58232` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.428719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.428839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1113cbce924ad9b68690db65c58232)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:27.428839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.438032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1259/2492] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:27.440625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.455071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f090e8-e5be-4c92-b210-eddc9c8f2792 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:27.461770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:27.462472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.462813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.463036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] PATH_INFO: `/v3/projects/b3917d5e7a604f07a298cb87c30c1adb/users/3359162e60fa4429927a0d4ac7900831/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.480395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3917d5e7a604f07a298cb87c30c1adb, user_id=3359162e60fa4429927a0d4ac7900831, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:27.483140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.645627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1260/2493] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:27 2022] PUT /identity/v3/projects/b3917d5e7a604f07a298cb87c30c1adb/users/3359162e60fa4429927a0d4ac7900831/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:27.650059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.722706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096172c-6645-44d3-b40d-3aac2e56a455 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:27.727430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:27.728052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.728337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.728615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.729309 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:27.731101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.742475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1261/2494] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:05:27.746869 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.758725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067052d0-b8dd-4086-a2ab-c244e4f089ad admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:27.763564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab601ae-920e-4738-b196-457a8900999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:27.764259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab601ae-920e-4738-b196-457a8900999d admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.774098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab601ae-920e-4738-b196-457a8900999d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.774098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab601ae-920e-4738-b196-457a8900999d admin admin] PATH_INFO: `/v3/projects/b3917d5e7a604f07a298cb87c30c1adb/users/3359162e60fa4429927a0d4ac7900831/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.774098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab601ae-920e-4738-b196-457a8900999d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3917d5e7a604f07a298cb87c30c1adb, user_id=3359162e60fa4429927a0d4ac7900831, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:27.774098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab601ae-920e-4738-b196-457a8900999d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:27.782759 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1262/2495] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:27 2022] PUT /identity/v3/projects/b3917d5e7a604f07a298cb87c30c1adb/users/3359162e60fa4429927a0d4ac7900831/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:27.783581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1113cbce924ad9b68690db65c58232'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:27.790856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1113cbce924ad9b68690db65c58232'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:27.793402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e687b-2393-4f00-8254-548b9feab597 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:27.793722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e687b-2393-4f00-8254-548b9feab597 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:27.794007 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e687b-2393-4f00-8254-548b9feab597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:27.822932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-980e687b-2393-4f00-8254-548b9feab597 None None] MFA Rules not processed for user `3359162e60fa4429927a0d4ac7900831`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:27.824170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-980e687b-2393-4f00-8254-548b9feab597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:27.875765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:27.897465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1263/2496] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:05:27.902913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1113cbce924ad9b68690db65c58232'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:27.903877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1113cbce924ad9b68690db65c58232'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:27.909230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e687b-2393-4f00-8254-548b9feab597 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:27.913319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-980e687b-2393-4f00-8254-548b9feab597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:27.920462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1113cbce924ad9b68690db65c58232'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:27.931204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1234/2497] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:27 2022] DELETE /identity/v3/users/2c1113cbce924ad9b68690db65c58232 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:27.973082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e687b-2393-4f00-8254-548b9feab597 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:28.080368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:28.081158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:28.081605 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:28.081984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:28.085119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:28.086427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:28.170030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:28.171606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:28.182694 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1264/2498] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:28.277427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:28.278981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:28.354124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:28.356341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:28.365489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42495214-5904-4af2-b312-b071cac8764a admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:28.370340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:28.371187 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:28.371475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:28.371761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] PATH_INFO: `/v3/projects/ad8343ba84724cf1a53b40d346623657` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:28.372997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8343ba84724cf1a53b40d346623657)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:28.374166 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6744e-b91f-4a46-a386-af2ef9cb18b1 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:28.375124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:28.380491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211495e-2d7d-43b7-84af-6bab5f438e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:28.381551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211495e-2d7d-43b7-84af-6bab5f438e77 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:28.382038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211495e-2d7d-43b7-84af-6bab5f438e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:28.382528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211495e-2d7d-43b7-84af-6bab5f438e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:28.385554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c211495e-2d7d-43b7-84af-6bab5f438e77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:28.467115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211495e-2d7d-43b7-84af-6bab5f438e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:28.468753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211495e-2d7d-43b7-84af-6bab5f438e77 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:28.482295 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1265/2499] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:28.547256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8343ba84724cf1a53b40d346623657', 'request_id': 'req-a41bd102-bb57-4577-9623-df12c4f37797'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:28.555519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8343ba84724cf1a53b40d346623657', 'request_id': 'req-a41bd102-bb57-4577-9623-df12c4f37797'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:28.632163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8343ba84724cf1a53b40d346623657', 'request_id': 'req-a41bd102-bb57-4577-9623-df12c4f37797'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:28.648900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] The token cache is being invalidate because project ad8343ba84724cf1a53b40d346623657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:28.649356 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:28.650281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a41bd102-bb57-4577-9623-df12c4f37797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:28.652095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1235/2500] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:28 2022] DELETE /identity/v3/projects/ad8343ba84724cf1a53b40d346623657 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:28.656995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7091b-b920-41b8-8c02-9dd9b079f177 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:28.657478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7091b-b920-41b8-8c02-9dd9b079f177 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:28.657688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7091b-b920-41b8-8c02-9dd9b079f177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:28.685890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-44e7091b-b920-41b8-8c02-9dd9b079f177 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:28.687949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-44e7091b-b920-41b8-8c02-9dd9b079f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:28.778702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1266/2501] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:28.786656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85294-6f8e-4960-b420-a42e6a2cfd03 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:28.786948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85294-6f8e-4960-b420-a42e6a2cfd03 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:28.787315 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85294-6f8e-4960-b420-a42e6a2cfd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:28.808881 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f8a85294-6f8e-4960-b420-a42e6a2cfd03 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:28.810125 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f8a85294-6f8e-4960-b420-a42e6a2cfd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:28.819482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1236/2502] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:28.823868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7091b-b920-41b8-8c02-9dd9b079f177 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:28.835210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7091b-b920-41b8-8c02-9dd9b079f177 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:28.841137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:28.841695 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:28.841984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:28.842266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:28.842978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:28.843285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:28.844959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:28.859800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1267/2503] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:05:28.865124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a85294-6f8e-4960-b420-a42e6a2cfd03 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:28.876214 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a85294-6f8e-4960-b420-a42e6a2cfd03 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:28.881969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:28.882641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:28.882920 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:28.883193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:28.883860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:28.885837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:29.002286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1237/2504] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:28 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:29.007681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:29.017970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376160-cf84-41bd-9eb3-f8057716dcb5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:29.038781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:29.083337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:29.084026 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:29.084413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:29.085412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:29.085412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:29.091699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:29.175001 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1268/2505] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:29 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:05:29.181027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:29.193555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2350-9333-4914-929c-562d7345f3d0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:29.198635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:29.200316 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:29.201013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:29.201329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:29.201600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:29.202258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:29.206655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:29.215775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1238/2506] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:05:29.219846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:29.231410 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa05b4-b93d-4c8f-a98e-5d53bbbefa38 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:29.236476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8778d-0a7f-4a0b-a2e2-f5ef6f354fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:29.237130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8778d-0a7f-4a0b-a2e2-f5ef6f354fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:29.237472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8778d-0a7f-4a0b-a2e2-f5ef6f354fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:29.237850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8778d-0a7f-4a0b-a2e2-f5ef6f354fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:29.238715 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8778d-0a7f-4a0b-a2e2-f5ef6f354fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:29.241063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8778d-0a7f-4a0b-a2e2-f5ef6f354fb2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:29.255697 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1269/2507] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:29.257626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:29.268054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acba7b-433d-4e4d-9a39-8f63e9ef6eca admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:29.273635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:29.280032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:29.280032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:29.280032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] PATH_INFO: `/v3/projects/2d9e2c2769f549959a2afc6ef8f323be/users/a137b9ba865b45008458d60a8a254f67/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:29.441628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9e2c2769f549959a2afc6ef8f323be, user_id=a137b9ba865b45008458d60a8a254f67, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:29.444827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:29.530669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1239/2508] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:29 2022] PUT /identity/v3/projects/2d9e2c2769f549959a2afc6ef8f323be/users/a137b9ba865b45008458d60a8a254f67/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:29.542882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd114cc-5f4c-4318-8496-2cb03c96ce32 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:29.542882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd114cc-5f4c-4318-8496-2cb03c96ce32 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:29.543138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd114cc-5f4c-4318-8496-2cb03c96ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:29.575009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5dd114cc-5f4c-4318-8496-2cb03c96ce32 None None] MFA Rules not processed for user `a137b9ba865b45008458d60a8a254f67`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:29.576217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5dd114cc-5f4c-4318-8496-2cb03c96ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:29.657377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1270/2509] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:29.671570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:29.737401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84dcf4-d0c7-46d7-92e5-c4aba811f475 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:29.743173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:29.755894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:29.755894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:29.755894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:29.755894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:29.755894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:29.826743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:29.871058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1240/2510] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:29 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:29.875053 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd114cc-5f4c-4318-8496-2cb03c96ce32 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:29.886665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd114cc-5f4c-4318-8496-2cb03c96ce32 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:29.947214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:29.947840 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:29.948124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:29.948401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:29.949104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:29.951142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:30.073095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:30.081254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1271/2511] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:29 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:30.084613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:30.095403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dc3b1-4181-4684-b13c-ebd15754e33e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:30.100433 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:30.101054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:30.101342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:30.101655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:30.102385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:30.104110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:30.116199 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1241/2512] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:30.120684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:30.132664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209caaab-6c42-4e63-ba0b-5675905a9005 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:30.137976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:30.138716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:30.138986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:30.139397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] PATH_INFO: `/v3/projects/d766bb4feb884a47bd7d8b6ab1668337/users/0354715b57f24e55be8879067e27ee48/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:30.155486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d766bb4feb884a47bd7d8b6ab1668337, user_id=0354715b57f24e55be8879067e27ee48, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:30.158538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:30.269009 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1272/2513] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:30 2022] PUT /identity/v3/projects/d766bb4feb884a47bd7d8b6ab1668337/users/0354715b57f24e55be8879067e27ee48/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:30.275626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:30.286173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3bb5b-db47-413d-9967-1c63bcf2d0c8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:30.366767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62e55-3135-45f6-88dd-4fcffa11cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:30.370102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62e55-3135-45f6-88dd-4fcffa11cbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:30.370102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62e55-3135-45f6-88dd-4fcffa11cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:30.370102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62e55-3135-45f6-88dd-4fcffa11cbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:30.370102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c62e55-3135-45f6-88dd-4fcffa11cbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:30.370987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c62e55-3135-45f6-88dd-4fcffa11cbb6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:30.382882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1242/2514] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:30.387277 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:30.400061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cfbe-70af-4090-a4a4-0a5bcf2a27fd admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:30.405324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:30.406114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:30.406399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:30.406674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] PATH_INFO: `/v3/projects/d766bb4feb884a47bd7d8b6ab1668337/users/0354715b57f24e55be8879067e27ee48/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:30.408635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d766bb4feb884a47bd7d8b6ab1668337, user_id=0354715b57f24e55be8879067e27ee48, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:30.412641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:30.423486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1273/2515] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:30 2022] PUT /identity/v3/projects/d766bb4feb884a47bd7d8b6ab1668337/users/0354715b57f24e55be8879067e27ee48/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:30.435728 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f2930-4c65-475d-ba7d-12c0a4d52a63 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:30.436178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f2930-4c65-475d-ba7d-12c0a4d52a63 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:30.436462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f2930-4c65-475d-ba7d-12c0a4d52a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:30.464609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-066f2930-4c65-475d-ba7d-12c0a4d52a63 None None] MFA Rules not processed for user `0354715b57f24e55be8879067e27ee48`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:30.465871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-066f2930-4c65-475d-ba7d-12c0a4d52a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:30.483716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:30.539346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1243/2516] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:30.552460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:30.554449 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:30.619138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e627a3-9628-4bd7-a70d-f993886eb0b7 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:30.622814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaa91e-302e-4933-9a91-eb17c0b5c593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:30.623463 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaa91e-302e-4933-9a91-eb17c0b5c593 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:30.623753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaa91e-302e-4933-9a91-eb17c0b5c593 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:30.624034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaa91e-302e-4933-9a91-eb17c0b5c593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:30.633774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaa91e-302e-4933-9a91-eb17c0b5c593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:30.635234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaa91e-302e-4933-9a91-eb17c0b5c593 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:30.645570 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1274/2517] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:30.675320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f2930-4c65-475d-ba7d-12c0a4d52a63 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:30.749415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f2930-4c65-475d-ba7d-12c0a4d52a63 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:30.755738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:30.756701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:30.757127 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:30.757638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] PATH_INFO: `/v3/users/a137b9ba865b45008458d60a8a254f67` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:30.759130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a137b9ba865b45008458d60a8a254f67)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:30.761665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:31.012141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a137b9ba865b45008458d60a8a254f67'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:31.022263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a137b9ba865b45008458d60a8a254f67'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:31.126000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a137b9ba865b45008458d60a8a254f67'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:31.126690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a137b9ba865b45008458d60a8a254f67'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:31.140578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a137b9ba865b45008458d60a8a254f67'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:31.147467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1244/2518] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:30 2022] DELETE /identity/v3/users/a137b9ba865b45008458d60a8a254f67 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:31.152120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:31.152658 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:31.152777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:31.174249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:31.175633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:31.231909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:31.239663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1275/2519] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:31.249546 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:31.251361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:31.295390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:31.314393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdf0f-3825-4b9f-9e5d-1e0a2bea4074 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:31.318309 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:31.318933 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:31.319217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:31.319496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:31.330676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:31.332126 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:31.343534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1245/2520] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:31.879138 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:31.881217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:31.894066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadb3cf-db8c-4b48-a6a8-c63c12e1f309 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:31.900433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:31.901131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:31.901451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:31.901773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] PATH_INFO: `/v3/projects/2d9e2c2769f549959a2afc6ef8f323be` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:31.902996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9e2c2769f549959a2afc6ef8f323be)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:31.904967 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:32.032023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9e2c2769f549959a2afc6ef8f323be', 'request_id': 'req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.038191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9e2c2769f549959a2afc6ef8f323be', 'request_id': 'req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.117445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9e2c2769f549959a2afc6ef8f323be', 'request_id': 'req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.129014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] The token cache is being invalidate because project 2d9e2c2769f549959a2afc6ef8f323be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:32.129417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.130188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.131786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1276/2521] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:31 2022] DELETE /identity/v3/projects/2d9e2c2769f549959a2afc6ef8f323be => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:32.135917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:32.146325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f1f7-16cc-4314-adc2-8a39605fe4f6 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:32.208837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:32.209486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:32.209904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:32.210234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] PATH_INFO: `/v3/users/0354715b57f24e55be8879067e27ee48` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:32.211420 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0354715b57f24e55be8879067e27ee48)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:32.213473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:32.510639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0354715b57f24e55be8879067e27ee48'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.518648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0354715b57f24e55be8879067e27ee48'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.657337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0354715b57f24e55be8879067e27ee48'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.658140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0354715b57f24e55be8879067e27ee48'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.674432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d23b8769-109a-4e40-984b-e6862fdeb355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0354715b57f24e55be8879067e27ee48'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:32.681074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1246/2522] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:32 2022] DELETE /identity/v3/users/0354715b57f24e55be8879067e27ee48 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:33.338213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:33.338751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:33.355351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6606e-4d71-4b92-a3f2-dabfd3fa520c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:33.456600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:33.457267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:33.458725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:33.458725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] PATH_INFO: `/v3/projects/d766bb4feb884a47bd7d8b6ab1668337` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:33.460440 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d766bb4feb884a47bd7d8b6ab1668337)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:33.461290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:33.590623 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd766bb4feb884a47bd7d8b6ab1668337', 'request_id': 'req-c392c2cb-a123-41d0-be06-d8cea2978aff'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:33.600716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd766bb4feb884a47bd7d8b6ab1668337', 'request_id': 'req-c392c2cb-a123-41d0-be06-d8cea2978aff'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:33.736850 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd766bb4feb884a47bd7d8b6ab1668337', 'request_id': 'req-c392c2cb-a123-41d0-be06-d8cea2978aff'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:33.750363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] The token cache is being invalidate because project d766bb4feb884a47bd7d8b6ab1668337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:33.750653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:33.751377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:33.752925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1277/2523] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:33 2022] DELETE /identity/v3/projects/d766bb4feb884a47bd7d8b6ab1668337 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:33.758337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bc776-4099-4057-a1dd-38bd3a14ffc8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:33.758977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bc776-4099-4057-a1dd-38bd3a14ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:33.758977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bc776-4099-4057-a1dd-38bd3a14ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:33.782894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dc2bc776-4099-4057-a1dd-38bd3a14ffc8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:33.784699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dc2bc776-4099-4057-a1dd-38bd3a14ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:33.827627 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:33.829165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:33.851521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:33.871493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:33.888901 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1247/2524] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:33.890615 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef1b90-e71d-4db5-acb2-e4f92e0197e6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:33.890902 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef1b90-e71d-4db5-acb2-e4f92e0197e6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:33.891179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef1b90-e71d-4db5-acb2-e4f92e0197e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:33.920437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-dfef1b90-e71d-4db5-acb2-e4f92e0197e6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:33.921724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dfef1b90-e71d-4db5-acb2-e4f92e0197e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:33.932541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1248/2525] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:33.936545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392c2cb-a123-41d0-be06-d8cea2978aff admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:33.936800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef1b90-e71d-4db5-acb2-e4f92e0197e6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:33.943896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:33.945670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:33.945966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:33.946274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] PATH_INFO: `/v3/users/6184df18287d41ca92d4676d9569f52b` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:33.947279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef1b90-e71d-4db5-acb2-e4f92e0197e6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:33.947740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6184df18287d41ca92d4676d9569f52b)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:33.949949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:33.952672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:33.959068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:33.959068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:33.959068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:33.959068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:33.959068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:33.959068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:33.974736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1249/2526] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:05:33.975812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:33.987766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d0d4d-31e5-4f43-a460-a3395a5b875b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:33.993296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:33.994292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:33.994292 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:33.994576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:33.995249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:33.997171 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:34.101789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1250/2527] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:33 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:34.107113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:34.206935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a60e-b32c-4a22-b6fa-d4e0eec04d89 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:34.215653 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:34.216465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.216924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.217992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.218889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:34.222306 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:34.223039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6184df18287d41ca92d4676d9569f52b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:34.225102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6184df18287d41ca92d4676d9569f52b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:34.226173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6184df18287d41ca92d4676d9569f52b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:34.236002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6184df18287d41ca92d4676d9569f52b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:34.255087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-72bf3366-393c-4176-908a-a350f2cb8205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6184df18287d41ca92d4676d9569f52b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:34.332562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1251/2528] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:34 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:34.337729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:34.343517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:34.381406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e79ffb-d361-4aad-9c77-141e5430786c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:34.381406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:34.381406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.381406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.381805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.381805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:34.381805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:34.392599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1252/2529] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:05:34.400198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:34.404054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1278/2530] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:33 2022] DELETE /identity/v3/users/6184df18287d41ca92d4676d9569f52b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:34.408777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.409143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.409431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.415793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9120c9-34be-4afe-9d1c-1cd8e71779c7 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:34.435402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:34.436651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:34.512172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1279/2531] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:34.522618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:34.524210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:34.550989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:34.553311 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.554157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.555399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.556677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:34.559479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:34.574239 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1253/2532] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:05:34.582750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:34.597206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae822d-9d37-4980-a5ef-9fa9c8ab1dec admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:34.601323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105050c-7f37-40e1-91a1-4948c896d121 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:34.602600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:34.603325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.603656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.603904 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] PATH_INFO: `/v3/projects/824bd764785b49d5aebbdd7481f54fad/users/45d45a53f5864bcd9cc00b043f2bd787/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.605706 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e369d2-9dee-4693-992a-08381145079e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:34.606012 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e369d2-9dee-4693-992a-08381145079e service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.606301 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e369d2-9dee-4693-992a-08381145079e service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.606577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e369d2-9dee-4693-992a-08381145079e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.616635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e369d2-9dee-4693-992a-08381145079e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:34.618289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e369d2-9dee-4693-992a-08381145079e service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:34.626496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824bd764785b49d5aebbdd7481f54fad, user_id=45d45a53f5864bcd9cc00b043f2bd787, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:34.628279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1280/2533] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:34.629998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:34.733749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1254/2534] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:34 2022] PUT /identity/v3/projects/824bd764785b49d5aebbdd7481f54fad/users/45d45a53f5864bcd9cc00b043f2bd787/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:34.744909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecec06-7d7a-4f0d-9624-2b1097e102d2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.745304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecec06-7d7a-4f0d-9624-2b1097e102d2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.745689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecec06-7d7a-4f0d-9624-2b1097e102d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.774882 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4aecec06-7d7a-4f0d-9624-2b1097e102d2 None None] MFA Rules not processed for user `45d45a53f5864bcd9cc00b043f2bd787`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:34.776164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4aecec06-7d7a-4f0d-9624-2b1097e102d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:34.846102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1281/2535] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:34.851479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:34.938593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027bbb8-9264-4478-9b51-9fecc27a23f4 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:34.938593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:34.938593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:34.938593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:34.938992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:34.938992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:34.938992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.075579 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1255/2536] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:34 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:05:35.078032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecec06-7d7a-4f0d-9624-2b1097e102d2 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.091443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecec06-7d7a-4f0d-9624-2b1097e102d2 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:35.166492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:35.167133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.167413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.167778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.168521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:35.170511 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.195577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:35.298526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.307929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:35.319164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bbeba-939e-45be-9845-37a710917723 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:35.324869 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:35.325664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.326010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.326374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] PATH_INFO: `/v3/projects/184bdec10d7046a183b1db8f3fa5f33b` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.327717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184bdec10d7046a183b1db8f3fa5f33b)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:35.332179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.342535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1282/2537] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:35 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:05:35.347509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.358985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166ad1-66e5-4709-bb56-111dba6b512e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:35.363890 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:35.364541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.364835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.365118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.365889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:35.367533 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.378333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1283/2538] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:05:35.383432 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.394490 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9956-d75d-4c00-8b66-ec97b379b6b8 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:35.400099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:35.402217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.402217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.402217 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] PATH_INFO: `/v3/projects/1da816638f444ab5b17763b05e6ec939/users/fea3c6b357b24784a9b831dd7c6b9931/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.420849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da816638f444ab5b17763b05e6ec939, user_id=fea3c6b357b24784a9b831dd7c6b9931, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:35.423960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.449971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:35.529174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1284/2539] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:35 2022] PUT /identity/v3/projects/1da816638f444ab5b17763b05e6ec939/users/fea3c6b357b24784a9b831dd7c6b9931/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:35.534364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.538974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184bdec10d7046a183b1db8f3fa5f33b', 'request_id': 'req-fb2f38ef-c81e-46ef-be66-1a052a64e521'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:35.544991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184bdec10d7046a183b1db8f3fa5f33b', 'request_id': 'req-fb2f38ef-c81e-46ef-be66-1a052a64e521'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:35.628531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad42bb-fcf4-44c6-a737-ca684443e5a2 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:35.643572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184bdec10d7046a183b1db8f3fa5f33b', 'request_id': 'req-fb2f38ef-c81e-46ef-be66-1a052a64e521'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:35.668381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] The token cache is being invalidate because project 184bdec10d7046a183b1db8f3fa5f33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:35.669175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:35.670874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:35.673600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1256/2540] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:35 2022] DELETE /identity/v3/projects/184bdec10d7046a183b1db8f3fa5f33b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:35.686396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.690123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:35.711867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:35.712789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.713300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.713774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.714648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:35.716667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.728427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1285/2541] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:35.732544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.734987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:35.757848 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a1b7-1915-454c-ad92-69e12a058adb admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:35.766060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8895d-caae-404a-a265-47f02f304bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:35.768333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8895d-caae-404a-a265-47f02f304bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.768333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8895d-caae-404a-a265-47f02f304bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.768756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8895d-caae-404a-a265-47f02f304bfb admin admin] PATH_INFO: `/v3/projects/1da816638f444ab5b17763b05e6ec939/users/fea3c6b357b24784a9b831dd7c6b9931/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.774168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8895d-caae-404a-a265-47f02f304bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da816638f444ab5b17763b05e6ec939, user_id=fea3c6b357b24784a9b831dd7c6b9931, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:35.778855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8895d-caae-404a-a265-47f02f304bfb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.795233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1286/2542] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:35 2022] PUT /identity/v3/projects/1da816638f444ab5b17763b05e6ec939/users/fea3c6b357b24784a9b831dd7c6b9931/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:35.810837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.811218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.811579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.825699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f38ef-c81e-46ef-be66-1a052a64e521 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:35.842523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] MFA Rules not processed for user `fea3c6b357b24784a9b831dd7c6b9931`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:35.843860 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:35.902225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:35.903096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:35.903376 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:35.903647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] PATH_INFO: `/v3/users/3359162e60fa4429927a0d4ac7900831` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:35.906366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3359162e60fa4429927a0d4ac7900831)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:35.909107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:35.959110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1287/2543] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:35.966104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:35.967571 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:36.026551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7353b-1835-4726-b768-7eb57f4e6b01 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:36.036411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:36.036411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:36.036411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:36.036411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:36.042132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:36.043647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:36.055568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1288/2544] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:36.172163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:36.177663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3359162e60fa4429927a0d4ac7900831'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:36.182115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a50be7-78a1-47bf-a071-1a97652d84f9 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:36.184593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3359162e60fa4429927a0d4ac7900831'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:36.186086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:36.195720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:36.195720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:36.195720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:36.195720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:36.254611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:36.255991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:36.266098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1289/2545] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:36.306604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3359162e60fa4429927a0d4ac7900831'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:36.307759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3359162e60fa4429927a0d4ac7900831'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:36.330424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7badfb5-1098-4150-8188-13c0498d1e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3359162e60fa4429927a0d4ac7900831'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:36.337702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1257/2546] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:35 2022] DELETE /identity/v3/users/3359162e60fa4429927a0d4ac7900831 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:36.646787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:36.851141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:36.862543 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd693358-27dd-4266-b7ae-8f2d7fa939b7 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:36.938998 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:36.940051 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:36.940442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:36.940817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] PATH_INFO: `/v3/projects/b3917d5e7a604f07a298cb87c30c1adb` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:36.948701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3917d5e7a604f07a298cb87c30c1adb)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:36.948701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:37.029149 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:37.091003 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3917d5e7a604f07a298cb87c30c1adb', 'request_id': 'req-68257564-a6b1-4127-818e-0d52e27939fd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:37.100556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3917d5e7a604f07a298cb87c30c1adb', 'request_id': 'req-68257564-a6b1-4127-818e-0d52e27939fd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:37.246680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3917d5e7a604f07a298cb87c30c1adb', 'request_id': 'req-68257564-a6b1-4127-818e-0d52e27939fd'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:37.270514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] The token cache is being invalidate because project b3917d5e7a604f07a298cb87c30c1adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:37.271007 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:37.271958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-68257564-a6b1-4127-818e-0d52e27939fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:37.278902 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1290/2547] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:36 2022] DELETE /identity/v3/projects/b3917d5e7a604f07a298cb87c30c1adb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:37.285629 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7514acc-9d1e-4b58-b6c8-c4e48260a5cf None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.286521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7514acc-9d1e-4b58-b6c8-c4e48260a5cf None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.286804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7514acc-9d1e-4b58-b6c8-c4e48260a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:37.309213 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-b7514acc-9d1e-4b58-b6c8-c4e48260a5cf None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:37.310486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b7514acc-9d1e-4b58-b6c8-c4e48260a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:37.374178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1258/2548] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:37.384916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e029a-21b0-4957-b844-2cb5c06fef69 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.385232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e029a-21b0-4957-b844-2cb5c06fef69 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.387152 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e029a-21b0-4957-b844-2cb5c06fef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:37.407725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-f97e029a-21b0-4957-b844-2cb5c06fef69 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:37.409145 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f97e029a-21b0-4957-b844-2cb5c06fef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:37.418288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1291/2549] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:37.422848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7514acc-9d1e-4b58-b6c8-c4e48260a5cf None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:37.434079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7514acc-9d1e-4b58-b6c8-c4e48260a5cf None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:37.439774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:37.440484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.440774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.441053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:37.441795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:37.442179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:37.443802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:37.456612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1259/2550] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:05:37.463160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e029a-21b0-4957-b844-2cb5c06fef69 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:37.474447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e029a-21b0-4957-b844-2cb5c06fef69 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:37.480359 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:37.481197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.481972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.482446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:37.483228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:37.485809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:37.679308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1292/2551] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:37 2022] POST /identity/v3/projects => generated 401 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:37.683735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:37.694867 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330cb17-5036-4fd4-9be3-7e961b049d0c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:37.753005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:37.753648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.753970 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.754242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:37.754957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:37.757172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:37.904670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1260/2552] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:37 2022] POST /identity/v3/users => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:37.908716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:37.920606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803261ee-efc5-4d55-b871-840c1c092f94 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:37.925414 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:37.926080 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.926443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.926725 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:37.927408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:37.929060 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:37.940210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1293/2553] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:37.944948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:37.955497 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7d5e-e78d-44ff-81e6-b688c95ce5cb admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:37.961141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d9cac-7602-46b5-8814-d69e0c334ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:37.961810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d9cac-7602-46b5-8814-d69e0c334ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.962095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d9cac-7602-46b5-8814-d69e0c334ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.962377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d9cac-7602-46b5-8814-d69e0c334ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:37.963088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d9cac-7602-46b5-8814-d69e0c334ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:37.964709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d9cac-7602-46b5-8814-d69e0c334ea4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:37.976803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1261/2554] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:37.981266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:37.991366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba6e8f-2a70-4437-9cae-f6518d5d6d67 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:37.995915 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:37.996573 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:37.996878 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:37.997159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] PATH_INFO: `/v3/projects/722b38f215374add9a1513afa1130b4f/users/eb34e4161cbf40dfa8e8be2f914065c2/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:38.012681 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722b38f215374add9a1513afa1130b4f, user_id=eb34e4161cbf40dfa8e8be2f914065c2, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:38.015368 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:38.175699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:38.189735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1294/2555] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:37 2022] PUT /identity/v3/projects/722b38f215374add9a1513afa1130b4f/users/eb34e4161cbf40dfa8e8be2f914065c2/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:38.220310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:38.279534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529671bc-f62f-4d65-9e74-71eb09e5a807 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:38.279534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529671bc-f62f-4d65-9e74-71eb09e5a807 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:38.279534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529671bc-f62f-4d65-9e74-71eb09e5a807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:38.313936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-529671bc-f62f-4d65-9e74-71eb09e5a807 None None] MFA Rules not processed for user `eb34e4161cbf40dfa8e8be2f914065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:38.315169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-529671bc-f62f-4d65-9e74-71eb09e5a807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:38.382825 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1262/2556] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:38.387934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:38.453575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd18d6-c88f-4345-97d9-212051200ca5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:38.458464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:38.459093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:38.459385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:38.459800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:38.460476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:38.462461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:38.588250 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1295/2557] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:38 2022] POST /identity/v3/projects => generated 399 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:38.592844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529671bc-f62f-4d65-9e74-71eb09e5a807 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:38.604908 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529671bc-f62f-4d65-9e74-71eb09e5a807 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:38.667194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:38.667823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:38.668105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:38.668380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:38.669042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:38.671128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:38.800529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1263/2558] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:38 2022] POST /identity/v3/users => generated 306 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:38.806397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:38.817294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757ee5e-7d0d-498d-a0c2-63cc6e85fc5f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:38.822127 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:38.822756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:38.823046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:38.823327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:38.824035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:38.825685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:38.837482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1296/2559] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:38.841877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:38.852700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5eff-34b8-4403-9fdc-925ee459d07e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:38.857372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:38.858128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:38.858414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:38.858698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] PATH_INFO: `/v3/projects/8cc8bc0c07ff443381cd7f0c76ed8f92/users/dac73926fd0b469e937ff615b1ef9896/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:38.874373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc8bc0c07ff443381cd7f0c76ed8f92, user_id=dac73926fd0b469e937ff615b1ef9896, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:38.878139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:38.953030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1264/2560] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:38 2022] PUT /identity/v3/projects/8cc8bc0c07ff443381cd7f0c76ed8f92/users/dac73926fd0b469e937ff615b1ef9896/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:38.957269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:38.968973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136198f-8695-4069-b347-d6fcce7fc1c6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:39.026204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5a270-1e09-413d-a766-9efcfab09d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:39.026829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a270-1e09-413d-a766-9efcfab09d16 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:39.027111 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a270-1e09-413d-a766-9efcfab09d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:39.027385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a270-1e09-413d-a766-9efcfab09d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:39.028109 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5a270-1e09-413d-a766-9efcfab09d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:39.029760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5a270-1e09-413d-a766-9efcfab09d16 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:39.037678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:39.043020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1297/2561] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:39.047321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:39.058787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda7cbe-6d5d-40c3-83ad-a237eea1bf99 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:39.063766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:39.064443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:39.064724 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:39.065030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] PATH_INFO: `/v3/projects/8cc8bc0c07ff443381cd7f0c76ed8f92/users/dac73926fd0b469e937ff615b1ef9896/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:39.067064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc8bc0c07ff443381cd7f0c76ed8f92, user_id=dac73926fd0b469e937ff615b1ef9896, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:39.069771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:39.080231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1265/2562] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:39 2022] PUT /identity/v3/projects/8cc8bc0c07ff443381cd7f0c76ed8f92/users/dac73926fd0b469e937ff615b1ef9896/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:39.095999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:39.096406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:39.096638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:39.127420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] MFA Rules not processed for user `dac73926fd0b469e937ff615b1ef9896`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:39.128673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:39.199870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1298/2563] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:39.210975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:39.212849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:39.291079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef55bd-dff1-456f-8872-8b0c6360e054 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:39.291079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:39.291079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:39.291079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:39.291479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:39.291479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:39.291479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:39.300775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1266/2564] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:39.462795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:39.590607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:39.595562 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:39.606131 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:39.617146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb66a4-3b0f-4607-b7c1-ff03ba120457 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:39.622030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f081-4ee4-440b-939f-da492a9688a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:39.622806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f081-4ee4-440b-939f-da492a9688a7 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:39.623095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f081-4ee4-440b-939f-da492a9688a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:39.623374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f081-4ee4-440b-939f-da492a9688a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:39.669357 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068b34-5236-4e14-9f71-1a7082f669a3 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:39.674559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:39.675262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:39.675555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:39.675835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] PATH_INFO: `/v3/users/45d45a53f5864bcd9cc00b043f2bd787` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:39.677063 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d45a53f5864bcd9cc00b043f2bd787)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:39.679755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:39.689057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f081-4ee4-440b-939f-da492a9688a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:39.690661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f081-4ee4-440b-939f-da492a9688a7 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:39.702178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1267/2565] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:39.723082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:39.934837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d45a53f5864bcd9cc00b043f2bd787'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:39.935651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d45a53f5864bcd9cc00b043f2bd787'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:39.936268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d45a53f5864bcd9cc00b043f2bd787'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:39.945856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d45a53f5864bcd9cc00b043f2bd787'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:39.960496 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d45a53f5864bcd9cc00b043f2bd787'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:40.106036 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1299/2566] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:39 2022] DELETE /identity/v3/users/45d45a53f5864bcd9cc00b043f2bd787 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:40.110947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:40.111237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:40.111513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:40.132370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:40.133628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:40.196656 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1268/2567] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:40.206756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:40.208222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:40.228801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:40.269377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112748f-e728-4a8d-9e1c-079dddfd2dc6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:40.273068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:40.276564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:40.276564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:40.276564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:40.286548 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:40.288137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:40.298742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1300/2568] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:40.966854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:40.969321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:40.982395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc071e-ac08-4286-82e3-85764f4dc368 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:40.987700 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:40.988585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:40.989619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:40.990056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] PATH_INFO: `/v3/projects/824bd764785b49d5aebbdd7481f54fad` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:40.991639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824bd764785b49d5aebbdd7481f54fad)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:40.993832 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:41.135457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:41.151475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824bd764785b49d5aebbdd7481f54fad', 'request_id': 'req-0eb53e3d-6c18-48ee-ac79-f24afea778a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.157158 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824bd764785b49d5aebbdd7481f54fad', 'request_id': 'req-0eb53e3d-6c18-48ee-ac79-f24afea778a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.242743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824bd764785b49d5aebbdd7481f54fad', 'request_id': 'req-0eb53e3d-6c18-48ee-ac79-f24afea778a5'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.254504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] The token cache is being invalidate because project 824bd764785b49d5aebbdd7481f54fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:41.254793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.255434 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.256951 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1269/2569] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:40 2022] DELETE /identity/v3/projects/824bd764785b49d5aebbdd7481f54fad => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:41.261274 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:41.271429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f829f6-1ca6-4d2e-a98e-81b286a7ad70 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:41.334115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:41.334772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:41.335091 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:41.335371 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] PATH_INFO: `/v3/users/fea3c6b357b24784a9b831dd7c6b9931` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:41.336564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea3c6b357b24784a9b831dd7c6b9931)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:41.340016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:41.692631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea3c6b357b24784a9b831dd7c6b9931'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.693308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea3c6b357b24784a9b831dd7c6b9931'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.693945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea3c6b357b24784a9b831dd7c6b9931'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.704195 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea3c6b357b24784a9b831dd7c6b9931'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.722993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea3c6b357b24784a9b831dd7c6b9931'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:41.897821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1301/2570] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:41 2022] DELETE /identity/v3/users/fea3c6b357b24784a9b831dd7c6b9931 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:42.219259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:42.220836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:42.307929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53e3d-6c18-48ee-ac79-f24afea778a5 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:42.375442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f4d43-a8f2-4f27-bf6e-9789a3c866e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:42.376544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f4d43-a8f2-4f27-bf6e-9789a3c866e3 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:42.377071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f4d43-a8f2-4f27-bf6e-9789a3c866e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:42.377767 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f4d43-a8f2-4f27-bf6e-9789a3c866e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:42.381435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5b6f4d43-a8f2-4f27-bf6e-9789a3c866e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:42.426506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:42.426506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:42.480947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f4d43-a8f2-4f27-bf6e-9789a3c866e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:42.482858 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f4d43-a8f2-4f27-bf6e-9789a3c866e3 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:42.486879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:42.494442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1270/2571] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:42.515072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbbd6-f504-4d01-8ae4-5fd3eddae9bf admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:42.521610 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:42.523881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:42.524910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:42.525387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] PATH_INFO: `/v3/projects/1da816638f444ab5b17763b05e6ec939` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:42.526806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da816638f444ab5b17763b05e6ec939)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:42.528829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:42.698126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da816638f444ab5b17763b05e6ec939', 'request_id': 'req-d6269590-aed1-46e4-839c-24a02139e8e8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:42.704856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da816638f444ab5b17763b05e6ec939', 'request_id': 'req-d6269590-aed1-46e4-839c-24a02139e8e8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:42.851224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da816638f444ab5b17763b05e6ec939', 'request_id': 'req-d6269590-aed1-46e4-839c-24a02139e8e8'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:42.863802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] The token cache is being invalidate because project 1da816638f444ab5b17763b05e6ec939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:42.864090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:42.864764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-d6269590-aed1-46e4-839c-24a02139e8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:42.867666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1302/2572] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:42 2022] DELETE /identity/v3/projects/1da816638f444ab5b17763b05e6ec939 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:42.872768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832657-0ed8-4f01-8fcf-662e8c46fef7 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:42.873006 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832657-0ed8-4f01-8fcf-662e8c46fef7 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:42.873350 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832657-0ed8-4f01-8fcf-662e8c46fef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:42.894358 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e2832657-0ed8-4f01-8fcf-662e8c46fef7 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:42.896198 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e2832657-0ed8-4f01-8fcf-662e8c46fef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:42.912815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:42.982145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1271/2573] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:05:42.984255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d73f-6a79-4873-a253-78fca357c417 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:42.984613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d73f-6a79-4873-a253-78fca357c417 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:42.985487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d73f-6a79-4873-a253-78fca357c417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.009996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d358d73f-6a79-4873-a253-78fca357c417 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:43.011252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d358d73f-6a79-4873-a253-78fca357c417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:43.020631 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1303/2574] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:43.025686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832657-0ed8-4f01-8fcf-662e8c46fef7 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:43.037504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832657-0ed8-4f01-8fcf-662e8c46fef7 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:43.042815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:43.043533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.043771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.044052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.044861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:43.045193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:43.046947 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:43.067663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1272/2575] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:05:43.069288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358d73f-6a79-4873-a253-78fca357c417 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:43.079775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358d73f-6a79-4873-a253-78fca357c417 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:43.086164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:43.086834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.087117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.087394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.088972 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:43.090034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:43.233211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1304/2576] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:43 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:43.234403 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:43.244848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077092f-2184-426c-8b97-c52e6c00d3cf admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:43.305820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:43.306743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.306995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.307367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.307941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:43.309913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:43.514529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1273/2577] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:43 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:43.522093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:43.529920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c7f99-7e6d-4ca9-abc8-88d4d1b05977 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:43.534834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:43.535424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.536336 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.536618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.537321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:43.538969 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:43.549609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1305/2578] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:43.555346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:43.567173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1e11-b4fc-44a4-9d4c-2af400722c4d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:43.572604 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70adf9-8e92-4867-bdf9-1df6d19a79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:43.575985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70adf9-8e92-4867-bdf9-1df6d19a79fe admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.575985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70adf9-8e92-4867-bdf9-1df6d19a79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.575985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70adf9-8e92-4867-bdf9-1df6d19a79fe admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.575985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70adf9-8e92-4867-bdf9-1df6d19a79fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:43.576527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70adf9-8e92-4867-bdf9-1df6d19a79fe admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:43.588571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1274/2579] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:43.593085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:43.604813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2afc-5e63-4c42-8e1a-d3433a628b75 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:43.612083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:43.612083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.612461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.612569 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] PATH_INFO: `/v3/projects/305cf4e459574d09ab14d930f26ae80f/users/d65893ab18b04fa39149216dd6751e01/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.631716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305cf4e459574d09ab14d930f26ae80f, user_id=d65893ab18b04fa39149216dd6751e01, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:43.634498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:43.766786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1306/2580] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:43 2022] PUT /identity/v3/projects/305cf4e459574d09ab14d930f26ae80f/users/d65893ab18b04fa39149216dd6751e01/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:43.768915 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34332-8d4f-4dd2-9ed1-e8686a1f4984 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.769331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34332-8d4f-4dd2-9ed1-e8686a1f4984 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.770366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34332-8d4f-4dd2-9ed1-e8686a1f4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.802733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-5fa34332-8d4f-4dd2-9ed1-e8686a1f4984 None None] MFA Rules not processed for user `d65893ab18b04fa39149216dd6751e01`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:43.804647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5fa34332-8d4f-4dd2-9ed1-e8686a1f4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:43.900943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1275/2581] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:05:43.905306 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:43.986832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36283129-a29c-43aa-91ce-cfdaca639705 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:43.992223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:43.993962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:43.993962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:43.993962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:43.994283 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:43.996090 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:44.009160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:44.117392 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1307/2582] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:43 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:44.118679 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa34332-8d4f-4dd2-9ed1-e8686a1f4984 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:44.136163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa34332-8d4f-4dd2-9ed1-e8686a1f4984 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:44.153178 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:44.213030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:44.215243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:44.215243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:44.215243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:44.215243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:44.217548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:44.389252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1276/2583] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:44 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:44.398861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:44.411677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb0e6b-d34c-4c3e-ba34-7c78e0185ca6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:44.417811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:44.419157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:44.419673 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:44.420107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:44.420974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:44.422874 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:44.442244 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1308/2584] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:44.453477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:44.464537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569855-c293-4700-bd0b-854d5ce4341f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:44.470300 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:44.471083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:44.471540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:44.472026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] PATH_INFO: `/v3/projects/67f347b256374a0693699e0303a05d61/users/52e5997b17734cc8930f6c5fed8972d3/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:44.494718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f347b256374a0693699e0303a05d61, user_id=52e5997b17734cc8930f6c5fed8972d3, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:44.513919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:44.631615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:44.632503 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1277/2585] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:44 2022] PUT /identity/v3/projects/67f347b256374a0693699e0303a05d61/users/52e5997b17734cc8930f6c5fed8972d3/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:44.641872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f29424-181c-45e1-aaec-9e859472eb34 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:44.743163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0d7a6-37e6-4c47-8fb6-e7beaab9f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:44.743835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d7a6-37e6-4c47-8fb6-e7beaab9f705 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:44.744122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d7a6-37e6-4c47-8fb6-e7beaab9f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:44.744400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d7a6-37e6-4c47-8fb6-e7beaab9f705 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:44.745134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0d7a6-37e6-4c47-8fb6-e7beaab9f705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:44.746812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0d7a6-37e6-4c47-8fb6-e7beaab9f705 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:44.759455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1309/2586] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:44.763681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:44.774544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f72d-d4c4-42e2-a3a5-3bb4cf84b0f6 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:44.780513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:44.781549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:44.781702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:44.782062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] PATH_INFO: `/v3/projects/67f347b256374a0693699e0303a05d61/users/52e5997b17734cc8930f6c5fed8972d3/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:44.784331 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f347b256374a0693699e0303a05d61, user_id=52e5997b17734cc8930f6c5fed8972d3, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:44.787686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:44.819616 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1278/2587] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:44 2022] PUT /identity/v3/projects/67f347b256374a0693699e0303a05d61/users/52e5997b17734cc8930f6c5fed8972d3/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:44.822560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015048a-6726-4bde-a4f9-39db16e44d4f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:44.823050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015048a-6726-4bde-a4f9-39db16e44d4f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:44.823896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015048a-6726-4bde-a4f9-39db16e44d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:44.874016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e015048a-6726-4bde-a4f9-39db16e44d4f None None] MFA Rules not processed for user `52e5997b17734cc8930f6c5fed8972d3`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:44.875439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e015048a-6726-4bde-a4f9-39db16e44d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:44.950029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1310/2588] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:44.960878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:44.962760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:45.038426 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af114-e74a-40db-86a0-54bd0b6736b8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:45.042351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:45.042943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:45.043194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:45.043469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:45.054529 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:45.056039 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:45.067674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1279/2589] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:45.280723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015048a-6726-4bde-a4f9-39db16e44d4f None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:45.364512 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015048a-6726-4bde-a4f9-39db16e44d4f None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:45.369269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:45.370537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:45.370537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:45.372142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] PATH_INFO: `/v3/users/d65893ab18b04fa39149216dd6751e01` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:45.374422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65893ab18b04fa39149216dd6751e01)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:45.376378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:45.379066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:45.653459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:45.655054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:45.675046 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c5cc-8658-4a8e-b5ef-b3896687e590 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:45.684327 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:45.684987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:45.685432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:45.685899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] PATH_INFO: `/v3/users/eb34e4161cbf40dfa8e8be2f914065c2` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:45.687361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb34e4161cbf40dfa8e8be2f914065c2)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:45.689950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:45.765918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65893ab18b04fa39149216dd6751e01'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:45.766575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65893ab18b04fa39149216dd6751e01'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:45.767233 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65893ab18b04fa39149216dd6751e01'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:45.774326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65893ab18b04fa39149216dd6751e01'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:45.787640 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e2d2d414-a2fe-4bea-950e-53ee51fba6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65893ab18b04fa39149216dd6751e01'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:45.938334 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1311/2590] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:45 2022] DELETE /identity/v3/users/d65893ab18b04fa39149216dd6751e01 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:45.943761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab05ca-a292-49c3-b3f5-b7bacafc4487 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:45.944086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab05ca-a292-49c3-b3f5-b7bacafc4487 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:45.945113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab05ca-a292-49c3-b3f5-b7bacafc4487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:45.967858 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-69ab05ca-a292-49c3-b3f5-b7bacafc4487 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:45.969177 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-69ab05ca-a292-49c3-b3f5-b7bacafc4487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:46.063779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb34e4161cbf40dfa8e8be2f914065c2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:46.065734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1312/2591] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:05:46.084142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb34e4161cbf40dfa8e8be2f914065c2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:46.168617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb34e4161cbf40dfa8e8be2f914065c2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:46.169347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb34e4161cbf40dfa8e8be2f914065c2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:46.171882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:46.186387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb34e4161cbf40dfa8e8be2f914065c2'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:46.197701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1280/2592] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:45 2022] DELETE /identity/v3/users/eb34e4161cbf40dfa8e8be2f914065c2 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:46.203154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:46.203606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:46.203784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:46.228035 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:46.229814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:46.330973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:46.333669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:46.349010 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1313/2593] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:46.360628 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:46.364611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:46.424424 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:46.450568 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d5a3-91a2-4086-bd2c-e128d0a275e2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:46.460870 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:46.463507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:46.463801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:46.464253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:46.470613 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518057d-22a4-4f18-bb9a-b0a96e7520a2 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:46.470868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:46.476685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:46.477345 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:46.477672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:46.478396 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:46.490068 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:46.491929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:46.497861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:46.500425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:46.505189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1314/2594] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:46.515092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1281/2595] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:47.193565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:47.195106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:47.208650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3575331-dfbb-487a-b391-1b6b4554dcc4 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:47.213582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:47.214254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:47.214625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:47.214920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] PATH_INFO: `/v3/users/6a4cc8dc12fe459cb46bd1ea5ce42f6e` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:47.216454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4cc8dc12fe459cb46bd1ea5ce42f6e)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:47.218553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:47.459466 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4cc8dc12fe459cb46bd1ea5ce42f6e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:47.460156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4cc8dc12fe459cb46bd1ea5ce42f6e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:47.460763 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4cc8dc12fe459cb46bd1ea5ce42f6e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:47.468578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4cc8dc12fe459cb46bd1ea5ce42f6e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:47.483528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4cc8dc12fe459cb46bd1ea5ce42f6e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:47.692805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1315/2596] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:47 2022] DELETE /identity/v3/users/6a4cc8dc12fe459cb46bd1ea5ce42f6e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:47.736513 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:47.738669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:47.741382 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:47.745827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:47.761355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447ba6-a3fb-4ab8-895d-c8238f2692b3 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:47.877553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd7398-cdfb-4ebf-87e7-f22e341011ac admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:47.885245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:47.886105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:47.886499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:47.886897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] PATH_INFO: `/v3/projects/722b38f215374add9a1513afa1130b4f` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:47.888241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=722b38f215374add9a1513afa1130b4f)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:47.890446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:47.904850 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:47.905632 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:47.905983 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:47.906357 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] PATH_INFO: `/v3/projects/305cf4e459574d09ab14d930f26ae80f` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:47.907645 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=305cf4e459574d09ab14d930f26ae80f)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:47.909798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:48.013411 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:48.014968 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722b38f215374add9a1513afa1130b4f', 'request_id': 'req-ad57807e-fc12-4dab-9d6d-b2f993558508'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.025949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722b38f215374add9a1513afa1130b4f', 'request_id': 'req-ad57807e-fc12-4dab-9d6d-b2f993558508'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.033977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305cf4e459574d09ab14d930f26ae80f', 'request_id': 'req-65447a81-1a74-4cb4-8d9c-06c55686bbdb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.039900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305cf4e459574d09ab14d930f26ae80f', 'request_id': 'req-65447a81-1a74-4cb4-8d9c-06c55686bbdb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.148331 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722b38f215374add9a1513afa1130b4f', 'request_id': 'req-ad57807e-fc12-4dab-9d6d-b2f993558508'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.172180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] The token cache is being invalidate because project 722b38f215374add9a1513afa1130b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:48.172661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.173713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.175699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1316/2597] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:47 2022] DELETE /identity/v3/projects/722b38f215374add9a1513afa1130b4f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:48.177746 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:48.198825 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:48.218008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305cf4e459574d09ab14d930f26ae80f', 'request_id': 'req-65447a81-1a74-4cb4-8d9c-06c55686bbdb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.239067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] The token cache is being invalidate because project 305cf4e459574d09ab14d930f26ae80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:48.239488 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.240705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.246586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1282/2598] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:47 2022] DELETE /identity/v3/projects/305cf4e459574d09ab14d930f26ae80f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:48.247617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:48.251713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:48.278928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:48.328532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57807e-fc12-4dab-9d6d-b2f993558508 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:48.368992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65447a81-1a74-4cb4-8d9c-06c55686bbdb admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:48.377108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:48.378295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:48.378742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:48.379256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] PATH_INFO: `/v3/users/dac73926fd0b469e937ff615b1ef9896` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:48.381206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac73926fd0b469e937ff615b1ef9896)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:48.383833 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:48.437864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:48.438868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:48.439329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:48.439798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] PATH_INFO: `/v3/projects/51795690a8c343019d4cf99bbcfd4054` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:48.441876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51795690a8c343019d4cf99bbcfd4054)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:48.443920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:48.678664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac73926fd0b469e937ff615b1ef9896'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.683827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51795690a8c343019d4cf99bbcfd4054', 'request_id': 'req-1e998302-5b11-421f-ab71-7bdfadabf05f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.686340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac73926fd0b469e937ff615b1ef9896'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.690892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51795690a8c343019d4cf99bbcfd4054', 'request_id': 'req-1e998302-5b11-421f-ab71-7bdfadabf05f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.799785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac73926fd0b469e937ff615b1ef9896'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.800415 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac73926fd0b469e937ff615b1ef9896'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.814113 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac73926fd0b469e937ff615b1ef9896'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.820865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1283/2599] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:48 2022] DELETE /identity/v3/users/dac73926fd0b469e937ff615b1ef9896 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:48.821787 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:48.825317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:48.924871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d6ab-3c81-405c-82c8-fe589cfc2d9d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:48.934497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51795690a8c343019d4cf99bbcfd4054', 'request_id': 'req-1e998302-5b11-421f-ab71-7bdfadabf05f'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.936681 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:48.938375 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:48.939019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:48.939554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] PATH_INFO: `/v3/users/52e5997b17734cc8930f6c5fed8972d3` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:48.940995 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e5997b17734cc8930f6c5fed8972d3)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:48.943974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:48.949385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] The token cache is being invalidate because project 51795690a8c343019d4cf99bbcfd4054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:48.950275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.950806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-1e998302-5b11-421f-ab71-7bdfadabf05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:48.953117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1317/2600] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:48 2022] DELETE /identity/v3/projects/51795690a8c343019d4cf99bbcfd4054 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:48.958857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c669d-d560-42e9-8947-fd7f347de215 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:48.959156 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c669d-d560-42e9-8947-fd7f347de215 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:48.959442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c669d-d560-42e9-8947-fd7f347de215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:48.983253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-641c669d-d560-42e9-8947-fd7f347de215 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:48.984556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-641c669d-d560-42e9-8947-fd7f347de215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:48.997555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1318/2601] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:49.008450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe1fe1-5b05-4632-a703-573c726ce2ae None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.008751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe1fe1-5b05-4632-a703-573c726ce2ae None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.009101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe1fe1-5b05-4632-a703-573c726ce2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.029585 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9efe1fe1-5b05-4632-a703-573c726ce2ae None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:49.030780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9efe1fe1-5b05-4632-a703-573c726ce2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:49.046839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1319/2602] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:49.050912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe1fe1-5b05-4632-a703-573c726ce2ae None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:49.061322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe1fe1-5b05-4632-a703-573c726ce2ae None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:49.069663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:49.075150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.075150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.075150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.075150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:49.075150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:49.075150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:49.090507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1320/2603] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:05:49.091663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:49.102531 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732c062-4013-40b9-ba4c-b6384528efd1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:49.115624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:49.115624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.115624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.115624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.116041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:49.116041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:49.298931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1321/2604] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:49 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:49.299714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:49.305163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e5997b17734cc8930f6c5fed8972d3'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:49.323030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e5997b17734cc8930f6c5fed8972d3'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:49.379261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e8049-52e4-4d0e-93c1-c23f941a2184 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:49.386147 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:49.386977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.387406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.387749 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.388538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:49.391134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:49.471659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e5997b17734cc8930f6c5fed8972d3'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:49.472390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e5997b17734cc8930f6c5fed8972d3'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:49.486504 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e5997b17734cc8930f6c5fed8972d3'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:49.494719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1284/2605] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:48 2022] DELETE /identity/v3/users/52e5997b17734cc8930f6c5fed8972d3 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:49.553510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1322/2606] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:49 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:05:49.553894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:49.554747 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:49.555581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:49.556618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:49.569953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc57fb1-8f49-4c4b-9f6f-ffc049f14305 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:49.658967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419cd55-7bc0-4d33-b242-b3fd4bbdba65 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:49.664571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:49.665218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.665500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.665813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] PATH_INFO: `/v3/projects/8cc8bc0c07ff443381cd7f0c76ed8f92` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.666986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc8bc0c07ff443381cd7f0c76ed8f92)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:49.669004 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:49.670818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:49.671446 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.671737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.672017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.673189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:49.674976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:49.689170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1323/2607] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:49.690391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:49.701047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c8c5-76eb-4e0d-85f6-0fa62b41cef2 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:49.705939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:49.706553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.706843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.707126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.708712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:49.710252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:49.721082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1324/2608] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:49.726498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:49.737356 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f925deb-4a1b-4d82-bf82-70fd2a81cfbe admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:49.743441 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611652b-b327-4fae-b025-0a2d75689306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:49.744272 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611652b-b327-4fae-b025-0a2d75689306 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.744563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611652b-b327-4fae-b025-0a2d75689306 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.744868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611652b-b327-4fae-b025-0a2d75689306 admin admin] PATH_INFO: `/v3/projects/4ffa55b562cf444fa37a4c9f1674846f/users/504eade4f902437b8f4e2c80f5c95326/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.763228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611652b-b327-4fae-b025-0a2d75689306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffa55b562cf444fa37a4c9f1674846f, user_id=504eade4f902437b8f4e2c80f5c95326, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:49.766165 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611652b-b327-4fae-b025-0a2d75689306 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:49.874018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1325/2609] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:49 2022] PUT /identity/v3/projects/4ffa55b562cf444fa37a4c9f1674846f/users/504eade4f902437b8f4e2c80f5c95326/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:49.892723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a4255-9154-4a73-ba8a-5fdaeb3cf497 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:49.892723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a4255-9154-4a73-ba8a-5fdaeb3cf497 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:49.892723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a4255-9154-4a73-ba8a-5fdaeb3cf497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:49.893268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc8bc0c07ff443381cd7f0c76ed8f92', 'request_id': 'req-f9efef42-f569-4db5-91b5-a9192efde7bd'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:49.901194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc8bc0c07ff443381cd7f0c76ed8f92', 'request_id': 'req-f9efef42-f569-4db5-91b5-a9192efde7bd'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:49.919606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-7d6a4255-9154-4a73-ba8a-5fdaeb3cf497 None None] MFA Rules not processed for user `504eade4f902437b8f4e2c80f5c95326`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:49.920906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7d6a4255-9154-4a73-ba8a-5fdaeb3cf497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:49.996964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1326/2610] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:05:50.002229 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a4255-9154-4a73-ba8a-5fdaeb3cf497 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.002622 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc8bc0c07ff443381cd7f0c76ed8f92', 'request_id': 'req-f9efef42-f569-4db5-91b5-a9192efde7bd'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.016580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] The token cache is being invalidate because project 8cc8bc0c07ff443381cd7f0c76ed8f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:50.016967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.017984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.019757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1285/2611] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:49 2022] DELETE /identity/v3/projects/8cc8bc0c07ff443381cd7f0c76ed8f92 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:50.023736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.025225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:50.088178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a4255-9154-4a73-ba8a-5fdaeb3cf497 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.100567 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:50.101343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efef42-f569-4db5-91b5-a9192efde7bd admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.103028 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e4031-6463-4a4d-bbc7-5ba43c38a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.104347 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e4031-6463-4a4d-bbc7-5ba43c38a65f admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.104861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e4031-6463-4a4d-bbc7-5ba43c38a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.105319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e4031-6463-4a4d-bbc7-5ba43c38a65f admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.108561 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e4031-6463-4a4d-bbc7-5ba43c38a65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.117027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e4031-6463-4a4d-bbc7-5ba43c38a65f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.117348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.117348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.117348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.117348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] PATH_INFO: `/v3/projects/67f347b256374a0693699e0303a05d61` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.117679 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f347b256374a0693699e0303a05d61)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.121010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.270587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1327/2612] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/projects => generated 363 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:05:50.272095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.272390 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.272675 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.294774 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:50.297032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:50.324605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:50.347100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f347b256374a0693699e0303a05d61', 'request_id': 'req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.354282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f347b256374a0693699e0303a05d61', 'request_id': 'req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.392096 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1328/2613] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:50.393112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.394641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:50.408495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26426f58-1fc3-48a2-b222-5e66d8a69a6c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.439619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f347b256374a0693699e0303a05d61', 'request_id': 'req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.452184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] The token cache is being invalidate because project 67f347b256374a0693699e0303a05d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:50.453161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.454086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-85c1af4e-5f18-4cc9-8c75-05c70179d0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:50.459298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1286/2614] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:50 2022] DELETE /identity/v3/projects/67f347b256374a0693699e0303a05d61 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:50.459298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4f869-c8dd-4429-bc93-503590038725 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.459298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4f869-c8dd-4429-bc93-503590038725 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.459298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4f869-c8dd-4429-bc93-503590038725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.477851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.478492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.478778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.479055 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.479817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.480442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-4cf4f869-c8dd-4429-bc93-503590038725 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:50.481754 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4cf4f869-c8dd-4429-bc93-503590038725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:50.481904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.491225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1287/2615] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:50.492522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029db1b9-01b2-4ed5-8f3c-dbf7be422e97 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.492811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029db1b9-01b2-4ed5-8f3c-dbf7be422e97 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.493091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029db1b9-01b2-4ed5-8f3c-dbf7be422e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.513381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-029db1b9-01b2-4ed5-8f3c-dbf7be422e97 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:50.514669 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-029db1b9-01b2-4ed5-8f3c-dbf7be422e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:50.523341 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1288/2616] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:50.524111 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029db1b9-01b2-4ed5-8f3c-dbf7be422e97 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.533322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029db1b9-01b2-4ed5-8f3c-dbf7be422e97 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.539067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7d8a-e024-4924-a6c9-7103f234fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.539749 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7d8a-e024-4924-a6c9-7103f234fd18 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.540023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7d8a-e024-4924-a6c9-7103f234fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.540299 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7d8a-e024-4924-a6c9-7103f234fd18 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.541001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7d8a-e024-4924-a6c9-7103f234fd18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:50.541310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7d8a-e024-4924-a6c9-7103f234fd18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.542954 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7d8a-e024-4924-a6c9-7103f234fd18 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.555141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1289/2617] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:05:50.558684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.558684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.558684 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.576893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:50.581023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:50.586710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1329/2618] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:50.593193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.601933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d7a66-a82a-4395-a8d6-2c25dbb3299d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.602742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1290/2619] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:50.606278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.607220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:50.615061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.616527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.616816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.617099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.617857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.620190 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.627849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c96fe-c434-45e8-ab63-accb25f3b354 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.635105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.636135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.636590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.637017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.638312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.641314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.659997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1291/2620] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:50.661962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.674278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6499c-b4cc-4fb6-a180-1e0416d58530 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.680135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.680793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.681080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.681362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.682117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:05:50.682428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.684073 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.696940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1292/2621] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:05:50.698007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.709355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df1314-4058-4ffd-8421-4ec51d83cb84 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.714181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.714866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.715152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.715432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] PATH_INFO: `/v3/projects/f279174e0a2a4e7ab8df23e9362ae1e9/users/eea70beee9eb47fe842f4539dd850eeb/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.732538 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f279174e0a2a4e7ab8df23e9362ae1e9, user_id=eea70beee9eb47fe842f4539dd850eeb, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.735484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.774153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1330/2622] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:50.775073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.844273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb0dfa-7244-4ef5-89f6-087be3c3ee76 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.850894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.851599 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.852024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.852333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.853025 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.855033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.873150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1293/2623] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:50 2022] PUT /identity/v3/projects/f279174e0a2a4e7ab8df23e9362ae1e9/users/eea70beee9eb47fe842f4539dd850eeb/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:50.874008 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:50.940555 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93f87-1398-4cb3-aca8-2b5adc2e0d37 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:50.946066 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:50.946701 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:50.950478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:50.950478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:50.950478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:50.950478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:50.983831 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1331/2624] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:50.985178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.047865 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e778f-fc67-46f0-8868-e4c95b242dc1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.053377 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.054047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.054339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.054626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.055332 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.056961 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.071701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1332/2625] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:51.071701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.077742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1294/2626] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:50 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:51.078710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.079397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283026a2-fa1f-48de-8107-26beba8a502a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.085161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac9bf-a01f-43a1-a7d9-8ed3571a0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.086290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac9bf-a01f-43a1-a7d9-8ed3571a0efa admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.086290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac9bf-a01f-43a1-a7d9-8ed3571a0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.086513 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac9bf-a01f-43a1-a7d9-8ed3571a0efa admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.087113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ac9bf-a01f-43a1-a7d9-8ed3571a0efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.089071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ac9bf-a01f-43a1-a7d9-8ed3571a0efa admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.090052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a882b-5ba1-4134-a4e8-b4025b556ec3 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.102310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.103051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.103338 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.104155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] PATH_INFO: `/v3/projects/f279174e0a2a4e7ab8df23e9362ae1e9/users/eea70beee9eb47fe842f4539dd850eeb/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.106328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f279174e0a2a4e7ab8df23e9362ae1e9, user_id=eea70beee9eb47fe842f4539dd850eeb, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.109363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.121735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1295/2627] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:51 2022] PUT /identity/v3/projects/f279174e0a2a4e7ab8df23e9362ae1e9/users/eea70beee9eb47fe842f4539dd850eeb/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:51.122655 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.204620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da646327-7bd1-4e83-83bc-02fe3bd1e5aa admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.209704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.210401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.210612 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.210894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.211766 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.213385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.226693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1333/2628] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:51 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:51.226693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953b9e-b284-459c-b59f-bc0e2ae7ffba None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.226693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953b9e-b284-459c-b59f-bc0e2ae7ffba None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.226693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953b9e-b284-459c-b59f-bc0e2ae7ffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.227150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1296/2629] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:51.228418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.238435 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861be1-401c-4704-af0b-96aec004d994 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.243658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.244278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.244566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.244841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.245627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.247237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.258131 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2b953b9e-b284-459c-b59f-bc0e2ae7ffba None None] MFA Rules not processed for user `eea70beee9eb47fe842f4539dd850eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:51.259477 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2b953b9e-b284-459c-b59f-bc0e2ae7ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:51.262941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1297/2630] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:51.262941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.271518 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3240-412f-4b09-ae52-2e7a337de6eb admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.276679 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.277320 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.277644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.277925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.278791 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.280413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.292266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1298/2631] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:51.292266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.303667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62368f-5d9d-4084-bf3f-f62ed89b65fe admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.308367 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.309000 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.309290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.309775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.310477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.312123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.323725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1299/2632] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:51.324523 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.337241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bc8db-96b0-4cb1-98eb-371f1dc79f25 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.342874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5c95c-3bee-43b3-bd14-b0709cb0f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.350346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c95c-3bee-43b3-bd14-b0709cb0f5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.350346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c95c-3bee-43b3-bd14-b0709cb0f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.350346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c95c-3bee-43b3-bd14-b0709cb0f5f2 admin admin] PATH_INFO: `/v3/projects/0c7341b059f2431e8d37df49e7b7476f/users/d201a3416a774120985f41165f6fe84d/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.350624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1334/2633] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:51.350624 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b953b9e-b284-459c-b59f-bc0e2ae7ffba None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.356871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b953b9e-b284-459c-b59f-bc0e2ae7ffba None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.361760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.362563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.362867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.363143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] PATH_INFO: `/v3/projects/68db6e38f5974a7890798c5947bd06b6/users/608033c156f34b6eb4b64d88376870c9/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.378183 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c95c-3bee-43b3-bd14-b0709cb0f5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7341b059f2431e8d37df49e7b7476f, user_id=d201a3416a774120985f41165f6fe84d, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.381047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68db6e38f5974a7890798c5947bd06b6, user_id=608033c156f34b6eb4b64d88376870c9, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.381533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c95c-3bee-43b3-bd14-b0709cb0f5f2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.383782 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.516033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1335/2634] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:51 2022] PUT /identity/v3/projects/68db6e38f5974a7890798c5947bd06b6/users/608033c156f34b6eb4b64d88376870c9/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:51.517875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.519710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:51.531122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1300/2635] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:51 2022] PUT /identity/v3/projects/0c7341b059f2431e8d37df49e7b7476f/users/d201a3416a774120985f41165f6fe84d/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:51.531122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73c173-4ec0-4061-ad54-de03404757e7 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.531122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73c173-4ec0-4061-ad54-de03404757e7 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.531122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73c173-4ec0-4061-ad54-de03404757e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.564799 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ca73c173-4ec0-4061-ad54-de03404757e7 None None] MFA Rules not processed for user `608033c156f34b6eb4b64d88376870c9`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:51.566175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ca73c173-4ec0-4061-ad54-de03404757e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:51.588168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd42ce-e38b-4da6-af77-b6bab69b0084 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.639841 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1301/2636] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:51.640409 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513166-56c4-427e-9163-5b61b1dfea34 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.640708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513166-56c4-427e-9163-5b61b1dfea34 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.641286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513166-56c4-427e-9163-5b61b1dfea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.653251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.653988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.654275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.654661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.661871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f8513166-56c4-427e-9163-5b61b1dfea34 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:51.663095 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f8513166-56c4-427e-9163-5b61b1dfea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:51.728099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.729930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.734804 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1302/2637] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:51.735689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513166-56c4-427e-9163-5b61b1dfea34 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.738129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:51.748542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1336/2638] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:51.749296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513166-56c4-427e-9163-5b61b1dfea34 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.749439 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.751191 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:51.754613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.755297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.755630 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.755906 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.756532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.758493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.811350 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa0d9-11a3-4428-b4cc-f512488d6746 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.815551 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.816202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.816502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.816777 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.826141 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.827838 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:51.838200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1337/2639] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:51.857218 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:51.904109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1303/2640] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:51 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:51.904344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:51.912197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbcc0-5744-4cf7-889e-2936d29424c9 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:51.970632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:51.971255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:51.971544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:51.971821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:51.972600 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:51.975340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:52.042326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:52.089873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1338/2641] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:51 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:52.094945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:52.106723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c8400-ce6a-4970-8c22-7b52235672d3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:52.108934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9311fe2-2a2f-4b92-93ae-2820df781fb2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:52.111498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:52.112133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:52.112420 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:52.112663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:52.112797 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:52.113281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:52.113495 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:52.113639 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:52.113894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:52.115268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:52.115698 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:52.126273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1339/2642] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:52.130637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:52.141024 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66b92-dffa-4522-896e-8e1e24b62a52 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:52.146769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:52.147530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:52.147950 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:52.148248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] PATH_INFO: `/v3/projects/3d0606a6b70847888e06f3a684ad6aee/users/d5b7145d31f24724ab9f26983663f53b/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:52.169730 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0606a6b70847888e06f3a684ad6aee, user_id=d5b7145d31f24724ab9f26983663f53b, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:52.172662 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:52.194571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:52.196266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:52.208211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1304/2643] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:52.298885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1340/2644] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:52 2022] PUT /identity/v3/projects/3d0606a6b70847888e06f3a684ad6aee/users/d5b7145d31f24724ab9f26983663f53b/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:05:52.303193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:52.315069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c97a63-9169-488b-a9c2-5f4b68ef6030 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:52.378618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:52.380391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b6cdf-8776-4a94-939f-6bc68504b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:52.381037 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b6cdf-8776-4a94-939f-6bc68504b233 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:52.381321 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b6cdf-8776-4a94-939f-6bc68504b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:52.381628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b6cdf-8776-4a94-939f-6bc68504b233 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:52.382365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b6cdf-8776-4a94-939f-6bc68504b233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:52.383973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b6cdf-8776-4a94-939f-6bc68504b233 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:52.394411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1305/2645] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:52.399397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:52.410315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ba31-9b3e-4784-b656-9bdd0c6d147f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:52.415258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:52.425222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:52.425222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:52.425222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] PATH_INFO: `/v3/projects/3d0606a6b70847888e06f3a684ad6aee/users/d5b7145d31f24724ab9f26983663f53b/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:52.425222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0606a6b70847888e06f3a684ad6aee, user_id=d5b7145d31f24724ab9f26983663f53b, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:52.425222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:52.435065 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1341/2646] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:52 2022] PUT /identity/v3/projects/3d0606a6b70847888e06f3a684ad6aee/users/d5b7145d31f24724ab9f26983663f53b/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:52.446551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89752b-7295-4817-b743-32e9f6376333 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:52.446848 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89752b-7295-4817-b743-32e9f6376333 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:52.454009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89752b-7295-4817-b743-32e9f6376333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:52.478468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-9e89752b-7295-4817-b743-32e9f6376333 None None] MFA Rules not processed for user `d5b7145d31f24724ab9f26983663f53b`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:52.482406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9e89752b-7295-4817-b743-32e9f6376333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:52.577673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1306/2647] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:52.595786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:52.598020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:52.673995 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9aaca-52db-47be-be4d-c9032c95bd56 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:52.677906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:52.677906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:52.677906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:52.677906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:52.734794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:52.736231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:52.745745 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1342/2648] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:52.896163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:53.462843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:53.618709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2adf2-40c8-4b7d-b557-7bf86948603e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:53.618709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2adf2-40c8-4b7d-b557-7bf86948603e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:53.618709 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2adf2-40c8-4b7d-b557-7bf86948603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:53.649671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2bc2adf2-40c8-4b7d-b557-7bf86948603e None None] MFA Rules not processed for user `d201a3416a774120985f41165f6fe84d`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:53.650897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2bc2adf2-40c8-4b7d-b557-7bf86948603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:53.737117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1307/2649] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:53.741856 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:53.806144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265c0f2-9986-487f-99c0-a8b10b872fdf service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:53.810775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:53.811401 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:53.811688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:53.811974 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:53.812932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:53.814918 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:53.918934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1343/2650] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:05:53 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:53.923418 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2adf2-40c8-4b7d-b557-7bf86948603e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:53.934950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2adf2-40c8-4b7d-b557-7bf86948603e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:53.993383 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:53.994029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:53.994310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:53.994583 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:53.995301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:53.997249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:54.021933 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:54.104107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1308/2651] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:05:53 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:05:54.108323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:54.120000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683722de-6cab-4b37-8e09-3cba228ff806 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:54.124881 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:54.125506 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:54.125816 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:54.126100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:54.127069 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:54.128792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:54.143951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1344/2652] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:54.145769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:54.157064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a898223-5dba-4dfc-a440-80d52fc70a20 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:54.164385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:54.164385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:54.164385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:54.164385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] PATH_INFO: `/v3/projects/41510aef69c94dc086f1b530595760cb/users/52aa13a011e34a0b9609091a4fb0009e/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:54.182015 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41510aef69c94dc086f1b530595760cb, user_id=52aa13a011e34a0b9609091a4fb0009e, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:54.185511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:54.222322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:54.259721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1309/2653] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:54 2022] PUT /identity/v3/projects/41510aef69c94dc086f1b530595760cb/users/52aa13a011e34a0b9609091a4fb0009e/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:54.262788 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:54.282105 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:54.284258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:54.284542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c3ff8-b49c-4bdf-9381-439d7c66e4f5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:54.365386 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:54.366423 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:54.366889 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:54.367358 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:54.368572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:54.371130 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:54.375566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79b74-5e7c-4ea9-9029-de55ec7beae4 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:54.381939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd56a8-0c10-44fb-8c3c-066144624060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:54.383001 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd56a8-0c10-44fb-8c3c-066144624060 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:54.383482 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd56a8-0c10-44fb-8c3c-066144624060 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:54.383919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd56a8-0c10-44fb-8c3c-066144624060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:54.386635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-84fd56a8-0c10-44fb-8c3c-066144624060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:54.392132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1345/2654] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:05:54.393499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:54.401190 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd56a8-0c10-44fb-8c3c-066144624060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:54.402662 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd56a8-0c10-44fb-8c3c-066144624060 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:54.403671 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9744324-5c20-475e-8785-fe8482ba5bdf admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:54.409810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e330-fab5-4384-8511-d1bcced7362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:54.419384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e330-fab5-4384-8511-d1bcced7362a admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:54.419384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e330-fab5-4384-8511-d1bcced7362a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:54.419384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e330-fab5-4384-8511-d1bcced7362a admin admin] PATH_INFO: `/v3/projects/41510aef69c94dc086f1b530595760cb/users/52aa13a011e34a0b9609091a4fb0009e/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:54.419384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e330-fab5-4384-8511-d1bcced7362a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41510aef69c94dc086f1b530595760cb, user_id=52aa13a011e34a0b9609091a4fb0009e, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:54.419817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1310/2655] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:54.419903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e330-fab5-4384-8511-d1bcced7362a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:54.435541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1346/2656] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:05:54 2022] PUT /identity/v3/projects/41510aef69c94dc086f1b530595760cb/users/52aa13a011e34a0b9609091a4fb0009e/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:54.768154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:55.205815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:56.145862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:56.146153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:56.146429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:56.154105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:56.176827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] MFA Rules not processed for user `52aa13a011e34a0b9609091a4fb0009e`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:56.178135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:56.279756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1311/2657] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:56.290304 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188554a1-29fd-4b27-89a4-119bc5821a29 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:56.290963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188554a1-29fd-4b27-89a4-119bc5821a29 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:56.291492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188554a1-29fd-4b27-89a4-119bc5821a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:56.314089 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-188554a1-29fd-4b27-89a4-119bc5821a29 None None] MFA Rules not processed for user `d201a3416a774120985f41165f6fe84d`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:56.315280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-188554a1-29fd-4b27-89a4-119bc5821a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:56.387016 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1347/2658] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:56.396668 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:56.398441 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:56.491045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b882bf-a97a-4c0b-8677-d16510296ed3 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:56.497233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0a371-7691-418c-94da-0878c442bec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784ac400fc5643a589d79d0314ee4a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:56.498107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a371-7691-418c-94da-0878c442bec8 service nova] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:56.498393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a371-7691-418c-94da-0878c442bec8 service nova] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:56.498764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a371-7691-418c-94da-0878c442bec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:56.516982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0a371-7691-418c-94da-0878c442bec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:56.520093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0a371-7691-418c-94da-0878c442bec8 service nova] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:56.534385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1312/2659] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:56.644188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188554a1-29fd-4b27-89a4-119bc5821a29 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:56.645152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:56.755604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188554a1-29fd-4b27-89a4-119bc5821a29 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:56.763271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:56.764125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:56.765346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:56.765346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] PATH_INFO: `/v3/users/504eade4f902437b8f4e2c80f5c95326` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:56.766429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=504eade4f902437b8f4e2c80f5c95326)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:56.771737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:57.031657 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504eade4f902437b8f4e2c80f5c95326'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:57.032231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504eade4f902437b8f4e2c80f5c95326'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:57.032906 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504eade4f902437b8f4e2c80f5c95326'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:57.040527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504eade4f902437b8f4e2c80f5c95326'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:57.053117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504eade4f902437b8f4e2c80f5c95326'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:57.145851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1348/2660] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:56 2022] DELETE /identity/v3/users/504eade4f902437b8f4e2c80f5c95326 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:57.158395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:57.158689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:57.159078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:57.178223 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:57.195880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:57.197779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:57.302365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1313/2661] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:57.322892 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:57.325313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:57.402113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2066b6-a39a-4950-97d9-9ebd867212ec admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:57.406093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:57.406734 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:57.407018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:57.407305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:57.434310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:57.436284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:57.458212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1349/2662] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:05:57.507805 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:58.055927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:58.058559 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:58.095021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad76f70-d127-42b2-8266-795d79e7e497 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:58.102722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:58.103429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:58.103895 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:58.104332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] PATH_INFO: `/v3/projects/4ffa55b562cf444fa37a4c9f1674846f` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:58.105997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffa55b562cf444fa37a4c9f1674846f)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:58.109544 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:58.307134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffa55b562cf444fa37a4c9f1674846f', 'request_id': 'req-e5ae4d00-9202-4b55-9792-9eda5bd97993'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.319413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffa55b562cf444fa37a4c9f1674846f', 'request_id': 'req-e5ae4d00-9202-4b55-9792-9eda5bd97993'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.407801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffa55b562cf444fa37a4c9f1674846f', 'request_id': 'req-e5ae4d00-9202-4b55-9792-9eda5bd97993'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.426866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] The token cache is being invalidate because project 4ffa55b562cf444fa37a4c9f1674846f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:58.427965 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.428771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.430399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1314/2663] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:58 2022] DELETE /identity/v3/projects/4ffa55b562cf444fa37a4c9f1674846f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:58.434693 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:58.445792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7044f-a3d6-4bda-9185-adff922b59c8 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:58.543742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:58.544875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:58.545989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:58.546475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] PATH_INFO: `/v3/users/eea70beee9eb47fe842f4539dd850eeb` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:58.548143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea70beee9eb47fe842f4539dd850eeb)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:58.551914 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:58.777102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:58.784801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:58.854348 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4d00-9202-4b55-9792-9eda5bd97993 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:58.858094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:58.858718 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:58.858999 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:58.859276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:58.861069 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:58.888333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea70beee9eb47fe842f4539dd850eeb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.889421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea70beee9eb47fe842f4539dd850eeb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.890639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea70beee9eb47fe842f4539dd850eeb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.904251 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea70beee9eb47fe842f4539dd850eeb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.921484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea70beee9eb47fe842f4539dd850eeb'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:58.939601 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:58.941055 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:58.951570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1315/2664] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:05:58.952390 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:58.953744 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:58.958483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:58.971139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f616b-1482-46b7-a244-bf9bb4f80409 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:58.976137 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:58.976785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:58.977074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:58.977394 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] PATH_INFO: `/v3/users/df9d84db168a4612be9e98681d12bcd7` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:58.978614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9d84db168a4612be9e98681d12bcd7)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:58.980571 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:58.992661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1350/2665] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:58 2022] DELETE /identity/v3/users/eea70beee9eb47fe842f4539dd850eeb => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:59.185891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9d84db168a4612be9e98681d12bcd7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.195835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9d84db168a4612be9e98681d12bcd7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.297564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9d84db168a4612be9e98681d12bcd7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.298446 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9d84db168a4612be9e98681d12bcd7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.326561 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9d84db168a4612be9e98681d12bcd7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.333594 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1316/2666] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:05:58 2022] DELETE /identity/v3/users/df9d84db168a4612be9e98681d12bcd7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:59.477965 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:59.481349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:59.569719 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43771f-ca4f-4e4b-97c9-64e7cd87e98e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:59.636302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:59.636941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:59.637344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:59.637660 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] PATH_INFO: `/v3/projects/f279174e0a2a4e7ab8df23e9362ae1e9` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:59.639004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f279174e0a2a4e7ab8df23e9362ae1e9)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:59.641000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:59.683507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:05:59.685162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:59.705243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db50b-405e-42a9-ad73-95ee387730fb admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:05:59.714774 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:05:59.715517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:59.717596 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:59.717893 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] PATH_INFO: `/v3/projects/4c2147ae553446c982f2368f1bb1a6e0` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:59.720665 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2147ae553446c982f2368f1bb1a6e0)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:05:59.723233 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:05:59.800325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f279174e0a2a4e7ab8df23e9362ae1e9', 'request_id': 'req-9109fd40-50a0-40f9-9993-0dc32bdcb42e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.808054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f279174e0a2a4e7ab8df23e9362ae1e9', 'request_id': 'req-9109fd40-50a0-40f9-9993-0dc32bdcb42e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.867756 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2147ae553446c982f2368f1bb1a6e0', 'request_id': 'req-d2a94b2e-49c6-4af0-bd42-f0063938ffac'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.870806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f279174e0a2a4e7ab8df23e9362ae1e9', 'request_id': 'req-9109fd40-50a0-40f9-9993-0dc32bdcb42e'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.883105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] The token cache is being invalidate because project f279174e0a2a4e7ab8df23e9362ae1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:05:59.883408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.884076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9109fd40-50a0-40f9-9993-0dc32bdcb42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.885612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1351/2667] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:59 2022] DELETE /identity/v3/projects/f279174e0a2a4e7ab8df23e9362ae1e9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:05:59.889967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2147ae553446c982f2368f1bb1a6e0', 'request_id': 'req-d2a94b2e-49c6-4af0-bd42-f0063938ffac'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.891755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91d47-cd2d-4672-9140-bb64a4e3caf5 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:59.892220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91d47-cd2d-4672-9140-bb64a4e3caf5 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:59.892750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91d47-cd2d-4672-9140-bb64a4e3caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:59.913397 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6bb91d47-cd2d-4672-9140-bb64a4e3caf5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:05:59.914775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6bb91d47-cd2d-4672-9140-bb64a4e3caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:05:59.979405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1352/2668] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:05:59.980428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2147ae553446c982f2368f1bb1a6e0', 'request_id': 'req-d2a94b2e-49c6-4af0-bd42-f0063938ffac'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:05:59.987796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4d1e-0619-429e-a460-35733f2a5973 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:05:59.988447 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4d1e-0619-429e-a460-35733f2a5973 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:05:59.988936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa4d1e-0619-429e-a460-35733f2a5973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:05:59.990389 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:00.003160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] The token cache is being invalidate because project 4c2147ae553446c982f2368f1bb1a6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:00.003550 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:00.005083 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d2a94b2e-49c6-4af0-bd42-f0063938ffac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:00.006670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1317/2669] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:05:59 2022] DELETE /identity/v3/projects/4c2147ae553446c982f2368f1bb1a6e0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:00.012326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee741-396a-4e41-91c2-4d59e5564f4e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.013673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee741-396a-4e41-91c2-4d59e5564f4e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.013673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee741-396a-4e41-91c2-4d59e5564f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.016868 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6ffa4d1e-0619-429e-a460-35733f2a5973 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:00.018189 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6ffa4d1e-0619-429e-a460-35733f2a5973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:00.027748 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1353/2670] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:00.032038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa4d1e-0619-429e-a460-35733f2a5973 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.035648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-a21ee741-396a-4e41-91c2-4d59e5564f4e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:00.036927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a21ee741-396a-4e41-91c2-4d59e5564f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:00.042689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa4d1e-0619-429e-a460-35733f2a5973 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.045960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1318/2671] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:00.049378 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.049579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.076989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.076989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.076989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:00.076989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.076989 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.077928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82015d-c584-4c47-921c-7e9eeca2bcf8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.077928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82015d-c584-4c47-921c-7e9eeca2bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.077928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82015d-c584-4c47-921c-7e9eeca2bcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.078442 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1354/2672] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:06:00.079453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-9a82015d-c584-4c47-921c-7e9eeca2bcf8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:00.079453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-9a82015d-c584-4c47-921c-7e9eeca2bcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:00.080672 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.092509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1319/2673] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:00.094577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da71c92-fec9-482b-a37f-7321f101bcf4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.096678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82015d-c584-4c47-921c-7e9eeca2bcf8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.099708 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.101832 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.102133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.102416 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.103099 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.107245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.107763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82015d-c584-4c47-921c-7e9eeca2bcf8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.112809 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.113502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.113824 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.114103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.114810 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:00.116958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.117140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.140076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1320/2674] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:06:00.145340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.156051 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739930ed-b84b-45d0-b3a8-bac98172a469 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.161973 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.162633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.162917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.163196 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.163921 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.165875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.213325 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1355/2675] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:00.217406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.283344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1321/2676] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:00.287285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.294451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ff3a1-292c-45b9-8a15-38fd3d175c69 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.356693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caf9a5-c803-4c29-bf73-1b820287978d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.362551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.363897 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.364107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.364437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.365114 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.367234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.373104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.373766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.374062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.374344 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.375033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.377500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.444373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1322/2677] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:00.448245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.458534 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc213-32f0-4aee-82e1-5758afed3ddc admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.466810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1356/2678] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:00.469478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.470326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.470478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.470613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.470922 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.471620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.473313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.481061 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b1edc-ff6f-48f9-a3a8-eee00e9b48c2 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.486666 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.487318 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.487442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1323/2679] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:06:00.487894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.488667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.488811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.489696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.491351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.500750 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6559-07f4-4b43-8940-da3f7f88fe74 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.504426 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1357/2680] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:06:00.508841 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.510549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.511250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.511633 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.511838 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.513130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.514800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.520786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809818-b5c1-482f-991d-d87b87c37fd1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.526722 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.531641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.531641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.531641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.531641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.531984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1324/2681] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:00.532084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.532952 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.544307 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca7f4e-5408-46d8-bded-b02ac622799e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.548726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1358/2682] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:00.551738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2c0d-ec85-4a0f-bb90-9c7669e93009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.559043 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2c0d-ec85-4a0f-bb90-9c7669e93009 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.559043 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2c0d-ec85-4a0f-bb90-9c7669e93009 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.559043 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2c0d-ec85-4a0f-bb90-9c7669e93009 admin admin] PATH_INFO: `/v3/projects/ace970fc486b419b806bbf015620ed64/users/6a29561a63dd4b18970a212c30ecef13/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.559370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.565461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f1ab9-1aaa-4524-a93c-ab9279b5fcd6 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:00.571046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc4274-2407-490b-97cc-364001f03c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:00.571834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4274-2407-490b-97cc-364001f03c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.572119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4274-2407-490b-97cc-364001f03c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.572229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2c0d-ec85-4a0f-bb90-9c7669e93009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace970fc486b419b806bbf015620ed64, user_id=6a29561a63dd4b18970a212c30ecef13, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.572395 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4274-2407-490b-97cc-364001f03c41 admin admin] PATH_INFO: `/v3/projects/dde513698adf416ca53af2d0113920fa/users/54e3d985f66e4535b55338f6341a0b08/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.575026 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2c0d-ec85-4a0f-bb90-9c7669e93009 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.588241 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4274-2407-490b-97cc-364001f03c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde513698adf416ca53af2d0113920fa, user_id=54e3d985f66e4535b55338f6341a0b08, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:00.591172 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4274-2407-490b-97cc-364001f03c41 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:00.700150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1325/2683] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:00 2022] PUT /identity/v3/projects/ace970fc486b419b806bbf015620ed64/users/6a29561a63dd4b18970a212c30ecef13/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:00.710971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15d6a-66c0-489c-8d1c-e3a1fe40be48 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.711295 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15d6a-66c0-489c-8d1c-e3a1fe40be48 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.711603 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15d6a-66c0-489c-8d1c-e3a1fe40be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.749319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d7c15d6a-66c0-489c-8d1c-e3a1fe40be48 None None] MFA Rules not processed for user `6a29561a63dd4b18970a212c30ecef13`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:00.750585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d7c15d6a-66c0-489c-8d1c-e3a1fe40be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:00.790957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1359/2684] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:00 2022] PUT /identity/v3/projects/dde513698adf416ca53af2d0113920fa/users/54e3d985f66e4535b55338f6341a0b08/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:00.802139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79fce-0dcd-4284-a84c-ca1f5edd8170 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:00.802481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79fce-0dcd-4284-a84c-ca1f5edd8170 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:00.802766 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79fce-0dcd-4284-a84c-ca1f5edd8170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:00.849444 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1326/2685] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:00.854195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15d6a-66c0-489c-8d1c-e3a1fe40be48 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:00.891308 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a9c79fce-0dcd-4284-a84c-ca1f5edd8170 None None] MFA Rules not processed for user `54e3d985f66e4535b55338f6341a0b08`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:00.894200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a9c79fce-0dcd-4284-a84c-ca1f5edd8170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:00.993734 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15d6a-66c0-489c-8d1c-e3a1fe40be48 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.004665 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1360/2686] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:01.009398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79fce-0dcd-4284-a84c-ca1f5edd8170 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.085122 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79fce-0dcd-4284-a84c-ca1f5edd8170 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.095817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.096460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.096741 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.097017 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.098323 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.100284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.101014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.106471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.106471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.106471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.106471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.106471 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.228685 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1361/2687] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:01 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:01.229738 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.254011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1327/2688] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:00 2022] POST /identity/v3/projects => generated 385 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:01.258807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.302422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314726d-2e52-4c63-91c8-58fc04ea37f7 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.337878 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d08f8-93f5-44aa-b0b7-d91e5a2b42aa admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.342727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.343351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.347387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.347387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.347387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.347387 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.365837 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.367249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.367540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.367820 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.368732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.370949 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.457959 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1328/2689] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:01 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:01.462613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.480875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1362/2690] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:01 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:01.482570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:01.489154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78a91-a76e-41cb-aa9d-bf5af3797d0b admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.492923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.504575 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.505222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.505554 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.505834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.506578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.508211 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.509014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d7a96-847f-471a-99bd-6b6ccd8cc9ef admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.515168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.515829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.516113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.516433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.517321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.518846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.525237 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1329/2691] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:01.528498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.533577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1363/2692] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:06:01.537943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.540522 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edface44-8006-4ecc-a8fb-c8ca16907639 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.546108 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.546738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.547024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.547298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.548030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.549279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe43ed-5eed-4626-9716-b2de07249b7d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.549784 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.561242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacecf-6a20-4e1b-8e06-27c5614730c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.561242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacecf-6a20-4e1b-8e06-27c5614730c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.561242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacecf-6a20-4e1b-8e06-27c5614730c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.561242 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacecf-6a20-4e1b-8e06-27c5614730c3 admin admin] PATH_INFO: `/v3/projects/0c21a0d660234ed2aac63a1400a1fba9/users/7cece3c71f80412283bd8c6b23a6e6d2/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.561666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1330/2693] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:06:01.565553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.575772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eacecf-6a20-4e1b-8e06-27c5614730c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c21a0d660234ed2aac63a1400a1fba9, user_id=7cece3c71f80412283bd8c6b23a6e6d2, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.576613 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166358b9-604e-4d22-a883-1a3a913398c1 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.578684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eacecf-6a20-4e1b-8e06-27c5614730c3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.582449 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:01.583164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.583450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.583735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] PATH_INFO: `/v3/projects/5201ac0fb79840fb912802a51ff48626/users/1edde589689b4db4a7a19684817b87ba/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.599200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5201ac0fb79840fb912802a51ff48626, user_id=1edde589689b4db4a7a19684817b87ba, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:01.601979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:01.841680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1331/2694] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:01 2022] PUT /identity/v3/projects/5201ac0fb79840fb912802a51ff48626/users/1edde589689b4db4a7a19684817b87ba/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:01.845400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1364/2695] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:01 2022] PUT /identity/v3/projects/0c21a0d660234ed2aac63a1400a1fba9/users/7cece3c71f80412283bd8c6b23a6e6d2/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:01.848998 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:01.853682 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96284eeb-a819-4acb-8edd-955ab6616eab None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:01.854160 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96284eeb-a819-4acb-8edd-955ab6616eab None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:01.854462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96284eeb-a819-4acb-8edd-955ab6616eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:01.887978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-96284eeb-a819-4acb-8edd-955ab6616eab None None] MFA Rules not processed for user `1edde589689b4db4a7a19684817b87ba`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:01.889214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-96284eeb-a819-4acb-8edd-955ab6616eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:01.932548 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f7664-aff0-45fd-b45c-e663d44144c2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:01.977559 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1365/2696] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:01.980228 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96284eeb-a819-4acb-8edd-955ab6616eab None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.005487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.005789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.005980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.006257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.007117 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.008751 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.020094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1332/2697] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:02.024255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.035664 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc08f0-50dc-47de-866a-30e6986b2d94 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.040896 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453aaf23-21e1-4d97-806b-371649e3e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.041674 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aaf23-21e1-4d97-806b-371649e3e110 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.041967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aaf23-21e1-4d97-806b-371649e3e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.042455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aaf23-21e1-4d97-806b-371649e3e110 admin admin] PATH_INFO: `/v3/projects/0c21a0d660234ed2aac63a1400a1fba9/users/7cece3c71f80412283bd8c6b23a6e6d2/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.044726 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aaf23-21e1-4d97-806b-371649e3e110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c21a0d660234ed2aac63a1400a1fba9, user_id=7cece3c71f80412283bd8c6b23a6e6d2, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.047586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aaf23-21e1-4d97-806b-371649e3e110 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.073423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1333/2698] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:02 2022] PUT /identity/v3/projects/0c21a0d660234ed2aac63a1400a1fba9/users/7cece3c71f80412283bd8c6b23a6e6d2/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:02.079396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.079702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.079991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.082415 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96284eeb-a819-4acb-8edd-955ab6616eab None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.124336 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] MFA Rules not processed for user `7cece3c71f80412283bd8c6b23a6e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:02.125742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:02.167485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.168281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.169489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.171095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.171479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.173919 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.232840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1334/2699] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:02.245505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.246944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:02.305576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1366/2700] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:01 2022] POST /identity/v3/projects => generated 387 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:02.310339 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.317806 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c4e7b-1840-4b35-9fcf-6810569ed460 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.374283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.375425 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.375860 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.376301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.386544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:02.404899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a5d1b-0134-4101-91ef-87401ae4d4af admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.410452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.414256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.414256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.414256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.414256 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.415403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.462772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.464279 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.475103 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1335/2701] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:02.526929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1367/2702] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:02 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:02.531542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.543713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bbcda-8e34-4468-84cb-a22375dd417d service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.548487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.549122 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.549412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.549739 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.550962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.552590 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.564153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1336/2703] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:06:02.569346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.582149 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a420a-f010-4421-a447-8196cff0a466 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.586898 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.587575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.587863 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.588146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] PATH_INFO: `/v3/projects/f799f4f7306b4a4fb651a79677dbcf32/users/8fff4c38ac404879b815d0e074c4c968/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.606022 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799f4f7306b4a4fb651a79677dbcf32, user_id=8fff4c38ac404879b815d0e074c4c968, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.608740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.767041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1368/2704] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:02 2022] PUT /identity/v3/projects/f799f4f7306b4a4fb651a79677dbcf32/users/8fff4c38ac404879b815d0e074c4c968/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:02.771262 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.784047 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ec529-3879-4d73-82af-a225a033e560 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.835509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.857452 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.858067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.858352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.858628 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.859798 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.860984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.876491 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1337/2705] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:02.881159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:02.894950 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c9b6-b44e-4245-9460-2fa1be99f4a7 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.900205 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e7b00-2656-4e68-8a42-d1a9a0502dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.901067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e7b00-2656-4e68-8a42-d1a9a0502dda admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.901486 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e7b00-2656-4e68-8a42-d1a9a0502dda admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.901800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e7b00-2656-4e68-8a42-d1a9a0502dda admin admin] PATH_INFO: `/v3/projects/f799f4f7306b4a4fb651a79677dbcf32/users/8fff4c38ac404879b815d0e074c4c968/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.904119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e7b00-2656-4e68-8a42-d1a9a0502dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799f4f7306b4a4fb651a79677dbcf32, user_id=8fff4c38ac404879b815d0e074c4c968, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:02.907442 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e7b00-2656-4e68-8a42-d1a9a0502dda admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:02.918855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ffcfa-df29-4827-ae70-b10c13740f74 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:02.936496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1338/2706] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:02 2022] PUT /identity/v3/projects/f799f4f7306b4a4fb651a79677dbcf32/users/8fff4c38ac404879b815d0e074c4c968/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:02.939219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51949223-f47a-4cfb-94b4-ca2ebf609641 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.939582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51949223-f47a-4cfb-94b4-ca2ebf609641 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.941492 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51949223-f47a-4cfb-94b4-ca2ebf609641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:02.985693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-51949223-f47a-4cfb-94b4-ca2ebf609641 None None] MFA Rules not processed for user `8fff4c38ac404879b815d0e074c4c968`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:02.986818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:02.986969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-51949223-f47a-4cfb-94b4-ca2ebf609641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:02.987455 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:02.987764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:02.989098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:03.055450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:03.056922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:03.070702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1369/2707] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:03.073569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1339/2708] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:03.083087 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:03.087409 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:03.099847 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2738-1122-4e7a-bec3-bca7d1686d1b service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:03.104315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:03.104764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:03.105101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:03.105372 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:03.116699 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:03.118374 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:03.131072 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1370/2709] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:03.636882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:04.529461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:04.572763 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51949223-f47a-4cfb-94b4-ca2ebf609641 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:04.583427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51949223-f47a-4cfb-94b4-ca2ebf609641 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:04.588140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8daf4-d57f-413d-9205-6681981129f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:04.588917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8daf4-d57f-413d-9205-6681981129f2 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:04.589267 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8daf4-d57f-413d-9205-6681981129f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:04.589586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8daf4-d57f-413d-9205-6681981129f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:04.665024 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8daf4-d57f-413d-9205-6681981129f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:04.666937 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8daf4-d57f-413d-9205-6681981129f2 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:04.677206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1340/2710] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:05.770988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:05.772690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:05.860583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe3c8-7103-48d4-98cc-d0719656b3b1 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:05.865161 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:05.865955 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:05.866240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:05.866516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] PATH_INFO: `/v3/users/608033c156f34b6eb4b64d88376870c9` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:05.870033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=608033c156f34b6eb4b64d88376870c9)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:05.870033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:05.881771 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:06.159762 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:06.174076 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608033c156f34b6eb4b64d88376870c9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:06.174753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608033c156f34b6eb4b64d88376870c9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:06.175364 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608033c156f34b6eb4b64d88376870c9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:06.182839 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608033c156f34b6eb4b64d88376870c9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:06.197211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608033c156f34b6eb4b64d88376870c9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:06.265478 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1371/2711] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:05 2022] DELETE /identity/v3/users/608033c156f34b6eb4b64d88376870c9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:06.271179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:06.271473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:06.271752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:06.292801 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:06.294080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:06.357142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1341/2712] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:06.367399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:06.368920 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:06.428568 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062e5e3-22c1-43dc-b496-d938d2b5b5ae admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:06.432214 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:06.432833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:06.433115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:06.433391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:06.443514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:06.445873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:06.455403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1372/2713] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:06.979542 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:06.981086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:06.997319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bd2da-14ec-455c-b971-9353bbc3763a None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:07.003333 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:07.004478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:07.004834 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:07.005650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] PATH_INFO: `/v3/projects/68db6e38f5974a7890798c5947bd06b6` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:07.009926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=68db6e38f5974a7890798c5947bd06b6)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:07.012135 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:07.122967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68db6e38f5974a7890798c5947bd06b6', 'request_id': 'req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.132889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68db6e38f5974a7890798c5947bd06b6', 'request_id': 'req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.204268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:07.205308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68db6e38f5974a7890798c5947bd06b6', 'request_id': 'req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.232802 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] The token cache is being invalidate because project 68db6e38f5974a7890798c5947bd06b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:07.233473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.234074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.238962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1342/2714] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:06 2022] DELETE /identity/v3/projects/68db6e38f5974a7890798c5947bd06b6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:07.243021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:07.255007 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a2803-05e1-4ebe-9c6c-f94fa8be0164 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:07.316986 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:07.319408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:07.319408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:07.319408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] PATH_INFO: `/v3/users/d5b7145d31f24724ab9f26983663f53b` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:07.319732 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b7145d31f24724ab9f26983663f53b)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:07.321433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:07.565406 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:07.718070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b7145d31f24724ab9f26983663f53b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.718907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b7145d31f24724ab9f26983663f53b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.719503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b7145d31f24724ab9f26983663f53b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.728066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b7145d31f24724ab9f26983663f53b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.741486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-7fa99bf8-c16a-4602-9e95-f90f2a61f259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b7145d31f24724ab9f26983663f53b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:07.859278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1373/2715] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:07 2022] DELETE /identity/v3/users/d5b7145d31f24724ab9f26983663f53b => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:08.389419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:08.391391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:08.405328 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce0b8-9e60-491d-99f8-d103ceb8b6ed admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:08.467174 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:08.467823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:08.468120 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:08.468386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] PATH_INFO: `/v3/projects/3d0606a6b70847888e06f3a684ad6aee` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:08.469595 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0606a6b70847888e06f3a684ad6aee)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:08.471527 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:08.618308 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0606a6b70847888e06f3a684ad6aee', 'request_id': 'req-eba5afae-9bf7-48cc-b942-b483f1cc5ece'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:08.624677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0606a6b70847888e06f3a684ad6aee', 'request_id': 'req-eba5afae-9bf7-48cc-b942-b483f1cc5ece'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:08.628132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=100 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:08.762542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:08.808680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0606a6b70847888e06f3a684ad6aee', 'request_id': 'req-eba5afae-9bf7-48cc-b942-b483f1cc5ece'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:08.824946 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] The token cache is being invalidate because project 3d0606a6b70847888e06f3a684ad6aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:08.825209 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:08.826019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-eba5afae-9bf7-48cc-b942-b483f1cc5ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:08.827547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1343/2716] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:08 2022] DELETE /identity/v3/projects/3d0606a6b70847888e06f3a684ad6aee => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:08.834074 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0484-d2a7-4c7a-8081-bd9ab24f7e71 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:08.834370 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0484-d2a7-4c7a-8081-bd9ab24f7e71 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:08.834650 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0484-d2a7-4c7a-8081-bd9ab24f7e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:08.862029 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a82e0484-d2a7-4c7a-8081-bd9ab24f7e71 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:08.863778 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a82e0484-d2a7-4c7a-8081-bd9ab24f7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:08.934185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1374/2717] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:08.943032 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512b0c-a354-4672-abbb-4261e26d6aac None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:08.943354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512b0c-a354-4672-abbb-4261e26d6aac None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:08.943642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512b0c-a354-4672-abbb-4261e26d6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:08.981545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0d512b0c-a354-4672-abbb-4261e26d6aac None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:08.981545 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0d512b0c-a354-4672-abbb-4261e26d6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:08.987789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1344/2718] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:08.994743 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0484-d2a7-4c7a-8081-bd9ab24f7e71 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:09.005713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0484-d2a7-4c7a-8081-bd9ab24f7e71 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:09.010836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:09.014193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:09.014193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:09.014193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:09.014193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:09.014193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:09.015059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:09.034192 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1375/2719] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:06:09.036138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512b0c-a354-4672-abbb-4261e26d6aac None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:09.046314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512b0c-a354-4672-abbb-4261e26d6aac None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:09.052053 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:09.052693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:09.052977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:09.053255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:09.053967 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:09.055953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:09.182745 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1345/2720] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:09 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:09.186929 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:09.198611 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f124f3-ec5e-4b97-aa58-9c6684302591 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:09.267821 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:09.270042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:09.270042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:09.270042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:09.270316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:09.272290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:09.401845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1376/2721] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:09 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:09.402057 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:09.407270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b3b7-1861-4b58-a26e-bfacdb50fa0c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:09.414925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:09.415687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:09.416042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:09.416381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:09.417393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:09.419141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:09.442044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1346/2722] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:09.445833 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:09.457909 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50520-4052-44f7-bd74-49ceea2e11b1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:09.463338 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2502f7-e2d4-458e-855a-27d15479b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:09.464784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2502f7-e2d4-458e-855a-27d15479b36a admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:09.465071 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2502f7-e2d4-458e-855a-27d15479b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:09.465349 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2502f7-e2d4-458e-855a-27d15479b36a admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:09.466170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2502f7-e2d4-458e-855a-27d15479b36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:09.467824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2502f7-e2d4-458e-855a-27d15479b36a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:09.486632 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1377/2723] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:09.487987 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:09.498609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7deae-fd27-43a7-9d08-081a4573b09d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:09.506835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:09.506835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:09.506835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:09.506835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] PATH_INFO: `/v3/projects/b295ff055d5e416d872ad55dcd3409ab/users/dc8ec5e4f148437aa64bdbda387808d2/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:09.526572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b295ff055d5e416d872ad55dcd3409ab, user_id=dc8ec5e4f148437aa64bdbda387808d2, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:09.529291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:09.647343 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1347/2724] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:09 2022] PUT /identity/v3/projects/b295ff055d5e416d872ad55dcd3409ab/users/dc8ec5e4f148437aa64bdbda387808d2/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:09.694346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:09.718243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:09.718542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:09.718830 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:09.874284 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] MFA Rules not processed for user `dc8ec5e4f148437aa64bdbda387808d2`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:09.875716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:09.944540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1378/2725] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:09.957253 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:09.959139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:10.025553 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd35641-79bd-40df-9036-1072745cd869 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:10.029925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:10.030769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:10.031176 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:10.031517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:10.044339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:10.053487 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:10.056541 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1348/2726] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:10.643572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:10.644985 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:10.657178 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121c32d-ac10-4f56-85cd-6e37abd883db None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:10.661215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa66b2-709c-42fa-9e61-17bd05de8ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:10.661851 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa66b2-709c-42fa-9e61-17bd05de8ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:10.662133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa66b2-709c-42fa-9e61-17bd05de8ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:10.662407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa66b2-709c-42fa-9e61-17bd05de8ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:10.664184 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-74aa66b2-709c-42fa-9e61-17bd05de8ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:10.724954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa66b2-709c-42fa-9e61-17bd05de8ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:10.726489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa66b2-709c-42fa-9e61-17bd05de8ad9 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:10.735405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1379/2727] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:11.269139 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:11.381578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:11.383459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:11.462837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185a13-3e47-4cb6-b565-fccb24d2198c service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:11.467976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:11.468661 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:11.468948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:11.469225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] PATH_INFO: `/v3/users/54e3d985f66e4535b55338f6341a0b08` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:11.470671 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e3d985f66e4535b55338f6341a0b08)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:11.473691 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:11.743667 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e3d985f66e4535b55338f6341a0b08'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:11.751217 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e3d985f66e4535b55338f6341a0b08'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:11.827676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e3d985f66e4535b55338f6341a0b08'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:11.828323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e3d985f66e4535b55338f6341a0b08'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:11.841757 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e3d985f66e4535b55338f6341a0b08'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:11.848489 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1349/2728] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:11 2022] DELETE /identity/v3/users/54e3d985f66e4535b55338f6341a0b08 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:11.853278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:11.853683 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:11.854030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:11.875726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:11.875726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:11.942302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1380/2729] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:11.952336 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:11.953900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:12.022207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac27b-2a57-43cc-9afa-b11c18080cc5 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:12.027144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:12.027793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:12.028075 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:12.028547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:12.053643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:12.053643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:12.063939 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1350/2730] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:12.075021 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:12.076451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:12.151113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003edc-a22a-4e9e-8b1b-ccac71dd4c8e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:12.157034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:12.157789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:12.158142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:12.158494 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:12.160945 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:12.229530 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:12.231002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:12.245958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1381/2731] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:12.351607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:12.557064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:12.559121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:12.585936 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eabe1-3974-4020-b97e-403efa20f354 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:12.590820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:12.591520 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:12.591971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:12.592246 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] PATH_INFO: `/v3/projects/dde513698adf416ca53af2d0113920fa` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:12.593479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde513698adf416ca53af2d0113920fa)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:12.595455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:12.736272 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde513698adf416ca53af2d0113920fa', 'request_id': 'req-38e74dd2-8893-4f5d-b40c-0867731a580c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:12.745911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde513698adf416ca53af2d0113920fa', 'request_id': 'req-38e74dd2-8893-4f5d-b40c-0867731a580c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:12.842521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde513698adf416ca53af2d0113920fa', 'request_id': 'req-38e74dd2-8893-4f5d-b40c-0867731a580c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:12.856322 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] The token cache is being invalidate because project dde513698adf416ca53af2d0113920fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:12.856600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:12.857259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:12.859337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1351/2732] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:12 2022] DELETE /identity/v3/projects/dde513698adf416ca53af2d0113920fa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:12.865726 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:12.893680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7f459-35ad-4167-99cb-eb42ef13ff4d service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:12.977337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:12.977911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:12.978202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:12.978479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] PATH_INFO: `/v3/users/7cece3c71f80412283bd8c6b23a6e6d2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:12.979667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cece3c71f80412283bd8c6b23a6e6d2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:12.981845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:13.069951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:13.218615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cece3c71f80412283bd8c6b23a6e6d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:13.219342 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cece3c71f80412283bd8c6b23a6e6d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:13.223143 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cece3c71f80412283bd8c6b23a6e6d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:13.232701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cece3c71f80412283bd8c6b23a6e6d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:13.251570 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f49ee045-4226-4392-a894-f7d875c43ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cece3c71f80412283bd8c6b23a6e6d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:13.391523 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1382/2733] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:12 2022] DELETE /identity/v3/users/7cece3c71f80412283bd8c6b23a6e6d2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:13.936651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:13.939373 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:13.956052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e74dd2-8893-4f5d-b40c-0867731a580c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:14.036551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:14.037235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:14.037551 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:14.037829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] PATH_INFO: `/v3/projects/0c21a0d660234ed2aac63a1400a1fba9` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:14.039648 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c21a0d660234ed2aac63a1400a1fba9)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:14.041637 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:14.046101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:14.179469 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c21a0d660234ed2aac63a1400a1fba9', 'request_id': 'req-ee64c7d9-c23b-4778-b86c-516e8b8d4295'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:14.187202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c21a0d660234ed2aac63a1400a1fba9', 'request_id': 'req-ee64c7d9-c23b-4778-b86c-516e8b8d4295'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:14.312361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c21a0d660234ed2aac63a1400a1fba9', 'request_id': 'req-ee64c7d9-c23b-4778-b86c-516e8b8d4295'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:14.335031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] The token cache is being invalidate because project 0c21a0d660234ed2aac63a1400a1fba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:14.336154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:14.341483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-ee64c7d9-c23b-4778-b86c-516e8b8d4295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:14.341483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1352/2734] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:13 2022] DELETE /identity/v3/projects/0c21a0d660234ed2aac63a1400a1fba9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:14.347810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeecd7-ea8a-45ba-93d6-c4bace80c8cb None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:14.348612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeecd7-ea8a-45ba-93d6-c4bace80c8cb None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:14.348612 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeecd7-ea8a-45ba-93d6-c4bace80c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:14.375930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5bdeecd7-ea8a-45ba-93d6-c4bace80c8cb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:14.377845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5bdeecd7-ea8a-45ba-93d6-c4bace80c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:14.442532 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1383/2735] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:14.450719 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1766cb-ee9c-4f18-937b-a9fda2e8dd64 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:14.451005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1766cb-ee9c-4f18-937b-a9fda2e8dd64 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:14.451370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1766cb-ee9c-4f18-937b-a9fda2e8dd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:14.474342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-0b1766cb-ee9c-4f18-937b-a9fda2e8dd64 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:14.475786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0b1766cb-ee9c-4f18-937b-a9fda2e8dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:14.494918 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1353/2736] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:14.499781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeecd7-ea8a-45ba-93d6-c4bace80c8cb None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:14.514088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeecd7-ea8a-45ba-93d6-c4bace80c8cb None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:14.522577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:14.525812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:14.526481 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:14.526793 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:14.527070 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:14.527780 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:14.528222 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:14.529954 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:14.544957 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1384/2737] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:06:14.554509 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1766cb-ee9c-4f18-937b-a9fda2e8dd64 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:14.567323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1766cb-ee9c-4f18-937b-a9fda2e8dd64 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:14.574121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:14.574938 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:14.575377 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:14.575743 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:14.576474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:14.578782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:14.703064 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1354/2738] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:14 2022] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:14.708247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:14.720555 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39798c5c-3866-4e90-9c22-10a76b7ef914 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:14.799588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:14.800504 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:14.800789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:14.801119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:14.801872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:14.804058 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:15.004448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1385/2739] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:14 2022] POST /identity/v3/users => generated 299 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:15.005693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:15.018493 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669dcd3-de02-4a48-8bb3-b86ad03cf157 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:15.050672 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:15.056714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:15.056714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:15.056714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:15.056714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:15.056714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:15.069244 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1355/2740] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:15.074000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:15.097689 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90006-5196-4ce9-ae9f-9d36527cd4db admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:15.105086 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c1777-9d0b-4fda-9980-e9ea6ffdabe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:15.105895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c1777-9d0b-4fda-9980-e9ea6ffdabe7 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:15.106408 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c1777-9d0b-4fda-9980-e9ea6ffdabe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:15.106905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c1777-9d0b-4fda-9980-e9ea6ffdabe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:15.108262 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c1777-9d0b-4fda-9980-e9ea6ffdabe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:15.110340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c1777-9d0b-4fda-9980-e9ea6ffdabe7 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:15.124505 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1386/2741] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:15.130411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:15.156275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b17e2-fa65-4f4a-a1fe-f0deb6c143e6 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:15.162029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:15.163097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:15.163593 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:15.164742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] PATH_INFO: `/v3/projects/8f9f2d54e9ed4686b75451cab52eb1fe/users/efd04b11029a4d71a67c89fbb2114ac9/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:15.196240 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9f2d54e9ed4686b75451cab52eb1fe, user_id=efd04b11029a4d71a67c89fbb2114ac9, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:15.201172 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:15.283572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:15.293219 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1356/2742] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:15 2022] PUT /identity/v3/projects/8f9f2d54e9ed4686b75451cab52eb1fe/users/efd04b11029a4d71a67c89fbb2114ac9/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:15.303928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:15.304458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:15.304999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:15.341168 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] MFA Rules not processed for user `efd04b11029a4d71a67c89fbb2114ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:15.342653 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:15.415924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1387/2743] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:15.428941 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:15.431427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:15.500811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9a23f-0898-4173-887c-c72e973b19d7 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:15.505417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb2a90-4f39-46af-a770-e710823a3fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:15.506089 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2a90-4f39-46af-a770-e710823a3fce service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:15.506370 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2a90-4f39-46af-a770-e710823a3fce service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:15.506654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2a90-4f39-46af-a770-e710823a3fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:15.516549 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb2a90-4f39-46af-a770-e710823a3fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:15.518070 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb2a90-4f39-46af-a770-e710823a3fce service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:15.530676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1357/2744] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:16.163137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:16.266826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:16.268711 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:16.392238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0df617-9708-4ed6-9a74-9d3656396992 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:16.398354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:16.398910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:16.399257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:16.399578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] PATH_INFO: `/v3/users/6a29561a63dd4b18970a212c30ecef13` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:16.401065 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a29561a63dd4b18970a212c30ecef13)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:16.403273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:16.689991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a29561a63dd4b18970a212c30ecef13'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:16.690770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a29561a63dd4b18970a212c30ecef13'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:16.691321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a29561a63dd4b18970a212c30ecef13'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:16.703276 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:16.704996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a29561a63dd4b18970a212c30ecef13'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:16.727302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a29561a63dd4b18970a212c30ecef13'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:16.820776 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1388/2745] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:16 2022] DELETE /identity/v3/users/6a29561a63dd4b18970a212c30ecef13 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:16.825462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:16.826098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:16.826098 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:16.849586 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:16.850898 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:16.930917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1358/2746] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:16.941988 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:16.943633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:17.013291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11916f6-b13f-4390-ab99-d5f632a6557e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:17.016956 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:17.017712 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:17.017994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:17.018313 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:17.028938 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:17.030450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:17.038392 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:17.042008 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1389/2747] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:17.516160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:17.518578 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:17.539371 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dabf5-45bf-4c48-b3d8-158dab5decef None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:17.549128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:17.550683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:17.563470 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:17.563979 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] PATH_INFO: `/v3/projects/ace970fc486b419b806bbf015620ed64` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:17.567276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace970fc486b419b806bbf015620ed64)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:17.571256 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:17.715736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace970fc486b419b806bbf015620ed64', 'request_id': 'req-95796eea-24d6-4f89-a478-8061e4dd5248'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:17.723364 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace970fc486b419b806bbf015620ed64', 'request_id': 'req-95796eea-24d6-4f89-a478-8061e4dd5248'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:17.817014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace970fc486b419b806bbf015620ed64', 'request_id': 'req-95796eea-24d6-4f89-a478-8061e4dd5248'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:17.830725 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] The token cache is being invalidate because project ace970fc486b419b806bbf015620ed64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:17.831572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:17.831715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:17.833597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1359/2748] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:17 2022] DELETE /identity/v3/projects/ace970fc486b419b806bbf015620ed64 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:17.837751 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:17.848252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344aff0-17dd-48ca-b9a4-a8a53a109491 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:17.912845 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:17.913486 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:17.913803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:17.914081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] PATH_INFO: `/v3/users/1edde589689b4db4a7a19684817b87ba` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:17.915294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edde589689b4db4a7a19684817b87ba)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:17.917253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:18.143563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edde589689b4db4a7a19684817b87ba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:18.143563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edde589689b4db4a7a19684817b87ba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:18.143563 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edde589689b4db4a7a19684817b87ba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:18.146211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:18.148223 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edde589689b4db4a7a19684817b87ba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:18.162871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edde589689b4db4a7a19684817b87ba'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:18.241993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1390/2749] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:17 2022] DELETE /identity/v3/users/1edde589689b4db4a7a19684817b87ba => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:18.851738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:18.851738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:18.867285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95796eea-24d6-4f89-a478-8061e4dd5248 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:18.929865 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:18.930531 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:18.930822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:18.931107 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] PATH_INFO: `/v3/projects/5201ac0fb79840fb912802a51ff48626` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:18.932399 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5201ac0fb79840fb912802a51ff48626)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:18.934443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:18.973304 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:19.113031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5201ac0fb79840fb912802a51ff48626', 'request_id': 'req-2e37194a-51e2-4716-9ac6-cec7f62780b0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.120391 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5201ac0fb79840fb912802a51ff48626', 'request_id': 'req-2e37194a-51e2-4716-9ac6-cec7f62780b0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.191368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5201ac0fb79840fb912802a51ff48626', 'request_id': 'req-2e37194a-51e2-4716-9ac6-cec7f62780b0'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.214366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] The token cache is being invalidate because project 5201ac0fb79840fb912802a51ff48626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:19.214900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.216261 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.224430 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1360/2750] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:18 2022] DELETE /identity/v3/projects/5201ac0fb79840fb912802a51ff48626 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:19.228281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:19.230990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:19.258038 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c04c-692f-40fc-97cf-e376642597d0 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:19.344519 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:19.359635 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:19.360380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:19.360733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:19.361083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] PATH_INFO: `/v3/users/8fff4c38ac404879b815d0e074c4c968` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:19.362476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fff4c38ac404879b815d0e074c4c968)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:19.364946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:19.581095 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fff4c38ac404879b815d0e074c4c968'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.582450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fff4c38ac404879b815d0e074c4c968'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.583137 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fff4c38ac404879b815d0e074c4c968'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.591773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fff4c38ac404879b815d0e074c4c968'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.605582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-30789a3f-a26b-4fb5-b76d-5e085b8bf847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fff4c38ac404879b815d0e074c4c968'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:19.746176 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1391/2751] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:19 2022] DELETE /identity/v3/users/8fff4c38ac404879b815d0e074c4c968 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:20.250764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:20.253197 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:20.295206 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37194a-51e2-4716-9ac6-cec7f62780b0 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:20.365721 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:20.366298 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:20.366635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:20.366925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] PATH_INFO: `/v3/projects/f799f4f7306b4a4fb651a79677dbcf32` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:20.368154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f799f4f7306b4a4fb651a79677dbcf32)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:20.370365 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:20.495035 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f799f4f7306b4a4fb651a79677dbcf32', 'request_id': 'req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:20.505027 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f799f4f7306b4a4fb651a79677dbcf32', 'request_id': 'req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:20.602453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f799f4f7306b4a4fb651a79677dbcf32', 'request_id': 'req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:20.618310 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] The token cache is being invalidate because project f799f4f7306b4a4fb651a79677dbcf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:20.618610 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:20.619290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c05aca17-88c1-47e9-b6ed-31ff78d57fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:20.621034 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1361/2752] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:20 2022] DELETE /identity/v3/projects/f799f4f7306b4a4fb651a79677dbcf32 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:20.627467 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d809dd-93a0-4091-bd16-6103b54e07f8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:20.628213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d809dd-93a0-4091-bd16-6103b54e07f8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:20.628213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d809dd-93a0-4091-bd16-6103b54e07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:20.654905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a1d809dd-93a0-4091-bd16-6103b54e07f8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:20.656134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a1d809dd-93a0-4091-bd16-6103b54e07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:20.718120 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1392/2753] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:20.729245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065397-f20c-43c6-959d-5972749411a9 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:20.729569 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065397-f20c-43c6-959d-5972749411a9 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:20.729871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065397-f20c-43c6-959d-5972749411a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:20.752164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d8065397-f20c-43c6-959d-5972749411a9 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:20.754040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d8065397-f20c-43c6-959d-5972749411a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:20.762476 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1362/2754] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:20.767030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d809dd-93a0-4091-bd16-6103b54e07f8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:20.780002 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d809dd-93a0-4091-bd16-6103b54e07f8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:20.785480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:20.786164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:20.786427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:20.786705 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:20.787421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:20.787731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:20.789348 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:20.802684 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1393/2755] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:06:20.806625 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065397-f20c-43c6-959d-5972749411a9 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:20.816822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065397-f20c-43c6-959d-5972749411a9 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:20.821704 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:20.822428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:20.822714 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:20.822992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:20.823666 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:20.825643 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:20.919891 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1363/2756] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:20 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:20.920545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:20.934646 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e90f56-2ccf-469a-a2cc-eaa3b672816d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.003855 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.004497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.004785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.005472 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.006245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.009476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:21.033607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:21.096462 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1394/2757] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:20 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:21.105230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:21.117152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc743d-a532-4a82-882e-3607b27827ff admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.122147 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.122899 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.123229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.123507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.124245 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.126019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:21.128592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:21.139226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1364/2758] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:21.144577 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:21.153798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f43eb4-013b-4154-87a5-9f1a15b6a0a1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.159669 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ff8cb-88b5-4b5c-b974-27824ee1aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.160380 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff8cb-88b5-4b5c-b974-27824ee1aedb admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.160668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff8cb-88b5-4b5c-b974-27824ee1aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.160948 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff8cb-88b5-4b5c-b974-27824ee1aedb admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.162193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ff8cb-88b5-4b5c-b974-27824ee1aedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.163822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ff8cb-88b5-4b5c-b974-27824ee1aedb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:21.176273 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1395/2759] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:21.180882 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:21.191923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35c06-ea7b-41b5-a2c1-4bfd83716173 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.196702 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.197380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.199332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.199332 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] PATH_INFO: `/v3/projects/888522b5b8b34cd9bb45ad14815b021f/users/6640d4947d5c474cb98a190319eb83c9/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.213234 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888522b5b8b34cd9bb45ad14815b021f, user_id=6640d4947d5c474cb98a190319eb83c9, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.215996 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:21.294736 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1365/2760] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:21 2022] PUT /identity/v3/projects/888522b5b8b34cd9bb45ad14815b021f/users/6640d4947d5c474cb98a190319eb83c9/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:21.306641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b190-01d7-4bd4-bbbc-9f71f41ceb1e None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.306930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b190-01d7-4bd4-bbbc-9f71f41ceb1e None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.307208 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b190-01d7-4bd4-bbbc-9f71f41ceb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.341056 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-aa11b190-01d7-4bd4-bbbc-9f71f41ceb1e None None] MFA Rules not processed for user `6640d4947d5c474cb98a190319eb83c9`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:21.344275 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-aa11b190-01d7-4bd4-bbbc-9f71f41ceb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:21.420717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1396/2761] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:21.425780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:21.506829 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4983-831b-43ec-ae61-39c61cb82018 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.512640 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.513282 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.513600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.513884 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.514563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.516521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:21.654167 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1366/2762] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:21 2022] POST /identity/v3/projects => generated 393 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:21.655716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11b190-01d7-4bd4-bbbc-9f71f41ceb1e None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:21.668098 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11b190-01d7-4bd4-bbbc-9f71f41ceb1e None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.729981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.730704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.730984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.731346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.732113 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.734182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:21.842595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1397/2763] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:21 2022] POST /identity/v3/users => generated 303 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:21.847094 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:21.858366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c0984-63d2-4470-b909-e2c31bb728cd admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.863845 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.864592 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.864991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.865360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.866189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.868060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:21.881397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1367/2764] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:21.887647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:21.900772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9dd8-e890-40d6-96e0-1801d800e8a1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:21.906280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:21.907064 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:21.907633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:21.908050 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] PATH_INFO: `/v3/projects/18db72c43b214386908c7f0a384cb34b/users/f5704b5894b54dac982c095504d173f9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:21.925601 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=18db72c43b214386908c7f0a384cb34b, user_id=f5704b5894b54dac982c095504d173f9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:21.928620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:22.063305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1398/2765] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:21 2022] PUT /identity/v3/projects/18db72c43b214386908c7f0a384cb34b/users/f5704b5894b54dac982c095504d173f9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:22.067713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:22.077968 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdee72-9197-4886-b307-898dea69eba2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:22.145056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79588ab1-2778-4ade-b9d9-5d55721ae2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:22.145820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588ab1-2778-4ade-b9d9-5d55721ae2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:22.146109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588ab1-2778-4ade-b9d9-5d55721ae2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:22.146457 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588ab1-2778-4ade-b9d9-5d55721ae2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:22.147270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79588ab1-2778-4ade-b9d9-5d55721ae2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:22.149168 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79588ab1-2778-4ade-b9d9-5d55721ae2a1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:22.163109 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1368/2766] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:22.167282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:22.180579 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e89ba4-aa9a-42ed-9316-d0e68e60fbde admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:22.185546 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:22.186538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:22.186817 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:22.187094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] PATH_INFO: `/v3/projects/18db72c43b214386908c7f0a384cb34b/users/f5704b5894b54dac982c095504d173f9/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:22.189436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18db72c43b214386908c7f0a384cb34b, user_id=f5704b5894b54dac982c095504d173f9, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:22.197164 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:22.204119 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1399/2767] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:22 2022] PUT /identity/v3/projects/18db72c43b214386908c7f0a384cb34b/users/f5704b5894b54dac982c095504d173f9/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:22.215431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0827-f4d0-419f-9d2f-46da53d34256 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:22.215727 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0827-f4d0-419f-9d2f-46da53d34256 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:22.224597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0827-f4d0-419f-9d2f-46da53d34256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:22.250547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-e27f0827-f4d0-419f-9d2f-46da53d34256 None None] MFA Rules not processed for user `f5704b5894b54dac982c095504d173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:22.251836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-e27f0827-f4d0-419f-9d2f-46da53d34256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:22.327871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1369/2768] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:22.342382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:22.344133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:22.388278 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:22.411862 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf09780-4acf-48d0-9ac3-08ec804f58e3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:22.415535 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:22.416153 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:22.416435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:22.416710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:22.427059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:22.428615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:22.439704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1400/2769] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:22.494313 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0827-f4d0-419f-9d2f-46da53d34256 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:22.499611 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0827-f4d0-419f-9d2f-46da53d34256 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:22.507340 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a4938-0eff-45ad-82fe-f594eb1386d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:22.508068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a4938-0eff-45ad-82fe-f594eb1386d7 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:22.508361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a4938-0eff-45ad-82fe-f594eb1386d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:22.508641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a4938-0eff-45ad-82fe-f594eb1386d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:22.577191 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a4938-0eff-45ad-82fe-f594eb1386d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:22.579638 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a4938-0eff-45ad-82fe-f594eb1386d7 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:22.594683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1370/2770] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:22.626184 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:22.722436 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:22.725310 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:22.797033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14bedf-0302-4387-ae28-62eb22cc8cd5 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:22.802244 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:22.802939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:22.803254 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:22.807541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] PATH_INFO: `/v3/users/efd04b11029a4d71a67c89fbb2114ac9` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:22.807541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd04b11029a4d71a67c89fbb2114ac9)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:22.807541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:23.065114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd04b11029a4d71a67c89fbb2114ac9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:23.065877 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd04b11029a4d71a67c89fbb2114ac9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:23.066572 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd04b11029a4d71a67c89fbb2114ac9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:23.074246 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd04b11029a4d71a67c89fbb2114ac9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:23.088789 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd04b11029a4d71a67c89fbb2114ac9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:23.125836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:23.183428 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1401/2771] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:22 2022] DELETE /identity/v3/users/efd04b11029a4d71a67c89fbb2114ac9 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:23.188562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:23.189080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:23.189576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:23.215304 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:23.216581 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:23.281597 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1371/2772] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:23.291704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:23.293151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:23.370288 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5a217-488e-4ac2-a1f5-864c546847b5 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:23.376867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:23.376867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:23.376867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:23.376867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:23.388764 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:23.390261 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:23.400908 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1402/2773] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:23.921388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:23.922981 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:23.937461 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ed700-e07b-4ef9-8a1f-fc58a1dc26eb None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:23.950243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:23.950911 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:23.951200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:23.951563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] PATH_INFO: `/v3/projects/8f9f2d54e9ed4686b75451cab52eb1fe` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:23.952800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9f2d54e9ed4686b75451cab52eb1fe)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:23.954880 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:24.077084 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9f2d54e9ed4686b75451cab52eb1fe', 'request_id': 'req-f7631600-27ef-4234-a2f4-2e8603e6436a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:24.082869 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9f2d54e9ed4686b75451cab52eb1fe', 'request_id': 'req-f7631600-27ef-4234-a2f4-2e8603e6436a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:24.086960 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:24.136635 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9f2d54e9ed4686b75451cab52eb1fe', 'request_id': 'req-f7631600-27ef-4234-a2f4-2e8603e6436a'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:24.149388 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] The token cache is being invalidate because project 8f9f2d54e9ed4686b75451cab52eb1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:24.149705 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:24.150369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f7631600-27ef-4234-a2f4-2e8603e6436a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:24.151866 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1372/2774] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:23 2022] DELETE /identity/v3/projects/8f9f2d54e9ed4686b75451cab52eb1fe => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:26.763770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:26.765227 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:26.778047 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dcbc-ee6b-4ea9-a814-fd8dd0bae10c service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:26.837427 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:26.838011 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:26.838297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:26.838578 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] PATH_INFO: `/v3/users/dc8ec5e4f148437aa64bdbda387808d2` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:26.839799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8ec5e4f148437aa64bdbda387808d2)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:26.841899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:27.005224 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:27.114188 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8ec5e4f148437aa64bdbda387808d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:27.114775 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8ec5e4f148437aa64bdbda387808d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:27.115417 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8ec5e4f148437aa64bdbda387808d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:27.123384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8ec5e4f148437aa64bdbda387808d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:27.136030 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8ec5e4f148437aa64bdbda387808d2'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:27.222884 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1403/2775] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:26 2022] DELETE /identity/v3/users/dc8ec5e4f148437aa64bdbda387808d2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:27.227765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:27.228274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:27.228516 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:27.251144 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:27.252494 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:27.317837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1373/2776] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:27.330499 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:27.332461 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:27.392322 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f049-30c0-4838-82e0-e2a8a7b4839d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:27.397151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:27.397814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:27.398102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:27.398387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:27.408107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:27.410307 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:27.422264 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1404/2777] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:27.809284 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:27.810930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:27.823720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675546f5-1391-4a07-bf19-256df85ceea6 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:27.828609 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:27.829432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:27.829752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:27.830033 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] PATH_INFO: `/v3/users/6640d4947d5c474cb98a190319eb83c9` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:27.831278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6640d4947d5c474cb98a190319eb83c9)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:27.833238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:27.905073 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:27.906484 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:27.921248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1be5a-41b6-43e0-af44-fb2540e92cac service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:27.927636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:27.929702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:27.929702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:27.929702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] PATH_INFO: `/v3/projects/b295ff055d5e416d872ad55dcd3409ab` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:27.930171 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b295ff055d5e416d872ad55dcd3409ab)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:27.932123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:28.020811 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6640d4947d5c474cb98a190319eb83c9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.028428 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6640d4947d5c474cb98a190319eb83c9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.060978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b295ff055d5e416d872ad55dcd3409ab', 'request_id': 'req-60e2496f-619b-42d0-99b6-250285f1697d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.067714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b295ff055d5e416d872ad55dcd3409ab', 'request_id': 'req-60e2496f-619b-42d0-99b6-250285f1697d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.165690 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6640d4947d5c474cb98a190319eb83c9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.166742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6640d4947d5c474cb98a190319eb83c9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.191210 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-d93caed8-8ebc-41b6-b0a9-e925ad5ace0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6640d4947d5c474cb98a190319eb83c9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.202413 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1374/2778] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:27 2022] DELETE /identity/v3/users/6640d4947d5c474cb98a190319eb83c9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:28.211479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.211479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.211479 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.235289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:28.236997 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:28.302741 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1375/2779] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:28.313473 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:28.315673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:28.329805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:28.331315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b295ff055d5e416d872ad55dcd3409ab', 'request_id': 'req-60e2496f-619b-42d0-99b6-250285f1697d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.348134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] The token cache is being invalidate because project b295ff055d5e416d872ad55dcd3409ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:28.348437 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.350736 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-60e2496f-619b-42d0-99b6-250285f1697d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:28.352963 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1405/2780] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:27 2022] DELETE /identity/v3/projects/b295ff055d5e416d872ad55dcd3409ab => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:28.358123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609be9d2-f698-4f3b-9f37-e851d2e08ac2 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.358528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609be9d2-f698-4f3b-9f37-e851d2e08ac2 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.358772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609be9d2-f698-4f3b-9f37-e851d2e08ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.385104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-609be9d2-f698-4f3b-9f37-e851d2e08ac2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:28.386454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-609be9d2-f698-4f3b-9f37-e851d2e08ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:28.404112 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1406/2781] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:28.406032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388757d-176c-41f8-8eba-b4a15287c936 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.406330 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388757d-176c-41f8-8eba-b4a15287c936 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.406770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388757d-176c-41f8-8eba-b4a15287c936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.407780 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937519d-a78f-4f56-a49d-72ecb158d0ca None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:28.416440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:28.417277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.417713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.418336 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.422360 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:28.437163 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:28.439074 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:28.444798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4388757d-176c-41f8-8eba-b4a15287c936 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:28.446597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4388757d-176c-41f8-8eba-b4a15287c936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:28.454683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1376/2782] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:28.458953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1407/2783] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:28.463443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:28.473877 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd1cb5-41f9-4cca-9f9c-35e8469f3074 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:28.479128 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:28.479794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.480080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.480347 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.481049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:28.481354 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:28.483058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:28.495795 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1377/2784] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:06:28.500975 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388757d-176c-41f8-8eba-b4a15287c936 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:28.514292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388757d-176c-41f8-8eba-b4a15287c936 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:28.520041 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:28.520753 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.521023 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.521895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.522237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:28.524235 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:28.541716 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:28.703014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1408/2785] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:28 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:28.709712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:28.729020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0f6c7-8777-4592-a6c5-a4087b0d73d9 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:28.814168 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:28.814812 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.815646 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.815849 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.816695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:28.818758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:28.945143 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1378/2786] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:28 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:28.951066 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:28.965696 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199a14-f39d-4753-bbd8-fd7e0b3512d4 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:28.973202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:28.973202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:28.973202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:28.973202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:28.978582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:28.978582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:28.986740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1409/2787] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:28.990940 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:29.003976 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:29.004735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74663-cd3a-49ac-8694-d35f6c763481 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:29.005910 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:29.010312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:29.015483 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:29.015813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:29.016110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:29.017837 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:29.020175 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:29.022888 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f518-a231-414d-8c83-ed81d80cd76e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:29.028604 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:29.029266 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:29.029643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:29.029923 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] PATH_INFO: `/v3/projects/888522b5b8b34cd9bb45ad14815b021f` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:29.031422 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=888522b5b8b34cd9bb45ad14815b021f)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:29.033617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1379/2788] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:29.033723 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:29.038769 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:29.051042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4a637-e10f-4960-88af-cac0cfa01608 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:29.059146 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7841d-cc2c-4c00-b318-742e549954c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:29.059875 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7841d-cc2c-4c00-b318-742e549954c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:29.060159 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7841d-cc2c-4c00-b318-742e549954c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:29.060438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7841d-cc2c-4c00-b318-742e549954c9 admin admin] PATH_INFO: `/v3/projects/3b64202a0bf34c298aed1656af5d31a7/users/7469f00c68a14ee082fdfd79374965a4/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:29.080651 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7841d-cc2c-4c00-b318-742e549954c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b64202a0bf34c298aed1656af5d31a7, user_id=7469f00c68a14ee082fdfd79374965a4, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:29.083986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7841d-cc2c-4c00-b318-742e549954c9 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:29.153925 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1380/2789] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:29 2022] PUT /identity/v3/projects/3b64202a0bf34c298aed1656af5d31a7/users/7469f00c68a14ee082fdfd79374965a4/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:29.166445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888522b5b8b34cd9bb45ad14815b021f', 'request_id': 'req-0cf191e9-926e-4791-8b4c-48f73e0fc011'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.166779 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:29.167093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:29.168498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:29.174507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888522b5b8b34cd9bb45ad14815b021f', 'request_id': 'req-0cf191e9-926e-4791-8b4c-48f73e0fc011'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.205230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] MFA Rules not processed for user `7469f00c68a14ee082fdfd79374965a4`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:29.207081 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:29.238686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888522b5b8b34cd9bb45ad14815b021f', 'request_id': 'req-0cf191e9-926e-4791-8b4c-48f73e0fc011'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.249786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] The token cache is being invalidate because project 888522b5b8b34cd9bb45ad14815b021f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:29.250083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.251004 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.253427 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:29.254220 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1410/2790] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:29 2022] DELETE /identity/v3/projects/888522b5b8b34cd9bb45ad14815b021f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:29.257939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:29.259435 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:29.289009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1381/2791] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:06:29.302208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:29.304157 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:29.349901 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf191e9-926e-4791-8b4c-48f73e0fc011 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:29.355057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:29.355710 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:29.356000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:29.368801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] PATH_INFO: `/v3/users/f5704b5894b54dac982c095504d173f9` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:29.368801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5704b5894b54dac982c095504d173f9)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:29.368801 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:29.393871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387b2c9-4314-4ec5-a48d-cf4bf843a689 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:29.397761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:29.398397 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:29.398680 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:29.398958 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:29.414023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:29.415490 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:29.432059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1382/2792] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:29.581540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5704b5894b54dac982c095504d173f9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.581911 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5704b5894b54dac982c095504d173f9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.582620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5704b5894b54dac982c095504d173f9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.592124 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5704b5894b54dac982c095504d173f9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.608962 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:INSERT=2,keystone:SELECT=83,keystone:DELETE=15 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:29.609289 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f7e8cf09-0f62-4357-99e9-ada39e4d4bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5704b5894b54dac982c095504d173f9'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:29.794602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1411/2793] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:29 2022] DELETE /identity/v3/users/f5704b5894b54dac982c095504d173f9 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:30.357717 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:30.371519 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393123ed-4169-4774-9b47-4d9213e304f7 service cinder] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:30.434991 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:30.435647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:30.435928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:30.436202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] PATH_INFO: `/v3/projects/18db72c43b214386908c7f0a384cb34b` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:30.437352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18db72c43b214386908c7f0a384cb34b)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:30.439608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:30.599040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18db72c43b214386908c7f0a384cb34b', 'request_id': 'req-91e35023-1516-4b89-96a7-62b756c40ab7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:30.606969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18db72c43b214386908c7f0a384cb34b', 'request_id': 'req-91e35023-1516-4b89-96a7-62b756c40ab7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:30.744975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18db72c43b214386908c7f0a384cb34b', 'request_id': 'req-91e35023-1516-4b89-96a7-62b756c40ab7'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:30.757572 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] The token cache is being invalidate because project 18db72c43b214386908c7f0a384cb34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:30.757868 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:30.758526 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-91e35023-1516-4b89-96a7-62b756c40ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:30.760049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1383/2794] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:30 2022] DELETE /identity/v3/projects/18db72c43b214386908c7f0a384cb34b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:30.765146 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240560-ad0c-4895-9dc7-1896c468f171 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:30.765827 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240560-ad0c-4895-9dc7-1896c468f171 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:30.765925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240560-ad0c-4895-9dc7-1896c468f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:30.786354 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-4b240560-ad0c-4895-9dc7-1896c468f171 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:30.787583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-4b240560-ad0c-4895-9dc7-1896c468f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:30.848305 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1412/2795] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:30.857599 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebce8a-0b1b-492f-a819-77aa44a664f5 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:30.857982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebce8a-0b1b-492f-a819-77aa44a664f5 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:30.858264 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebce8a-0b1b-492f-a819-77aa44a664f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:30.879951 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-c8ebce8a-0b1b-492f-a819-77aa44a664f5 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:30.881346 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c8ebce8a-0b1b-492f-a819-77aa44a664f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:30.889862 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1384/2796] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:30.894795 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240560-ad0c-4895-9dc7-1896c468f171 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:30.904565 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240560-ad0c-4895-9dc7-1896c468f171 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:30.909482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:30.910133 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:30.910419 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:30.910720 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:30.911444 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:30.911755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:30.913360 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:30.925773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1413/2797] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:06:30.930121 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebce8a-0b1b-492f-a819-77aa44a664f5 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:30.936065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:30.940819 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebce8a-0b1b-492f-a819-77aa44a664f5 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:30.945385 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:30.946056 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:30.946339 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:30.946617 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:30.947290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:30.949224 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:31.066642 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1385/2798] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:30 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:31.073057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:31.084765 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e759b-57d4-43f9-90d0-fde578053b43 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:31.148784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:31.149492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:31.149811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:31.150092 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:31.150794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:31.152822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:31.263514 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1414/2799] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:31 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:31.264740 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:31.279708 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbc49e-4dc8-4fe0-b33a-b568dd96cdcf admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:31.280278 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:31.281058 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:31.281412 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:31.281835 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:31.282602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:31.284334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:31.294692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1386/2800] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:31.298984 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:31.309786 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3382-1a3a-4781-afb5-8aba596d624f admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:31.314951 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cad60-7790-4180-a5ef-5f36cca7f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:31.320125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cad60-7790-4180-a5ef-5f36cca7f30c admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:31.320125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cad60-7790-4180-a5ef-5f36cca7f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:31.320125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cad60-7790-4180-a5ef-5f36cca7f30c admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:31.320125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cad60-7790-4180-a5ef-5f36cca7f30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:31.320125 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cad60-7790-4180-a5ef-5f36cca7f30c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:31.330118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1415/2801] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:06:31.334398 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:31.344547 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e519a-decb-4fb2-9fa4-084519fa3168 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:31.349093 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:31.349813 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:31.350101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:31.350381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] PATH_INFO: `/v3/projects/c2ac44136a2b459a8efe31f0bd42deea/users/8f374e9fd25a43f6ad8f6839d025133d/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:31.366683 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ac44136a2b459a8efe31f0bd42deea, user_id=8f374e9fd25a43f6ad8f6839d025133d, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:31.369352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:31.496836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1387/2802] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:31 2022] PUT /identity/v3/projects/c2ac44136a2b459a8efe31f0bd42deea/users/8f374e9fd25a43f6ad8f6839d025133d/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:31.507476 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2a6c2-170a-43bf-9436-7fca9b6ac435 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:31.507767 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2a6c2-170a-43bf-9436-7fca9b6ac435 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:31.508238 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2a6c2-170a-43bf-9436-7fca9b6ac435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:31.539281 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b9c2a6c2-170a-43bf-9436-7fca9b6ac435 None None] MFA Rules not processed for user `8f374e9fd25a43f6ad8f6839d025133d`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:31.540500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b9c2a6c2-170a-43bf-9436-7fca9b6ac435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:31.587487 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:31.616019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1416/2803] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:31.620720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:31.718297 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9a56-903c-43c9-b6c0-eb88eaa7bdd1 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:31.724097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:31.728876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:31.728876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:31.728876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:31.728876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:31.728876 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:31.832928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1388/2804] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:31 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:06:31.836939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2a6c2-170a-43bf-9436-7fca9b6ac435 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:31.848433 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2a6c2-170a-43bf-9436-7fca9b6ac435 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:31.915947 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:31.916575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:31.916857 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:31.917132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:31.917883 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:31.919853 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:31.999159 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1417/2805] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:31 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:32.003162 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:32.016130 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0209-e7e2-430a-95a9-bd0488e5839a admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:32.023711 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:32.024686 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:32.025154 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:32.027772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:32.027772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:32.028556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:32.043314 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1389/2806] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:32.048088 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:32.058655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb9fe-d06d-4e2e-bec7-ba76b3bab7f3 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:32.065049 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:32.065871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:32.066218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:32.066566 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] PATH_INFO: `/v3/projects/8b31254e3d1c46d2a51ddc946f1f2a7c/users/fcb82e604211400faa12fc72239a954d/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:32.084117 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b31254e3d1c46d2a51ddc946f1f2a7c, user_id=fcb82e604211400faa12fc72239a954d, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:32.089279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:32.157107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1418/2807] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:32 2022] PUT /identity/v3/projects/8b31254e3d1c46d2a51ddc946f1f2a7c/users/fcb82e604211400faa12fc72239a954d/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:32.162274 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:32.174266 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cfbe2-3652-4b1d-84d1-59be692ec3ca admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:32.239670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f78d9b-ae1c-4719-8c0b-3406acdae2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:32.240231 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f78d9b-ae1c-4719-8c0b-3406acdae2cf admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:32.240560 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f78d9b-ae1c-4719-8c0b-3406acdae2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:32.240735 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f78d9b-ae1c-4719-8c0b-3406acdae2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:32.241419 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f78d9b-ae1c-4719-8c0b-3406acdae2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:32.243079 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f78d9b-ae1c-4719-8c0b-3406acdae2cf admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:32.254215 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1390/2808] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:32.258541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:32.269811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57637f9-461a-4786-b8e4-531153192bf2 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:32.274978 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:32.276020 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:32.276454 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:32.276921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] PATH_INFO: `/v3/projects/8b31254e3d1c46d2a51ddc946f1f2a7c/users/fcb82e604211400faa12fc72239a954d/roles/d1e7f6a67fff40aa8769dd1ac7373b07` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:32.279810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b31254e3d1c46d2a51ddc946f1f2a7c, user_id=fcb82e604211400faa12fc72239a954d, role_id=d1e7f6a67fff40aa8769dd1ac7373b07)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:32.284556 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:32.297084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1419/2809] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:32 2022] PUT /identity/v3/projects/8b31254e3d1c46d2a51ddc946f1f2a7c/users/fcb82e604211400faa12fc72239a954d/roles/d1e7f6a67fff40aa8769dd1ac7373b07 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:32.307759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10060ba-7aeb-4e51-999c-82314086a72f None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:32.308054 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10060ba-7aeb-4e51-999c-82314086a72f None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:32.308342 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10060ba-7aeb-4e51-999c-82314086a72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:32.343077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f10060ba-7aeb-4e51-999c-82314086a72f None None] MFA Rules not processed for user `fcb82e604211400faa12fc72239a954d`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:32.348828 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f10060ba-7aeb-4e51-999c-82314086a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:32.349765 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:32.417889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1391/2810] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:32.429667 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:32.431542 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:32.496872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf14c3-6de3-40b6-a914-c21c1aa658fb admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:32.500885 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651993-d942-474f-80fd-a24d2209307a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:32.501503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651993-d942-474f-80fd-a24d2209307a service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:32.501818 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651993-d942-474f-80fd-a24d2209307a service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:32.502128 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651993-d942-474f-80fd-a24d2209307a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:32.522508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651993-d942-474f-80fd-a24d2209307a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:32.524150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651993-d942-474f-80fd-a24d2209307a service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:32.538057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1420/2811] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:33.212280 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10060ba-7aeb-4e51-999c-82314086a72f None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:33.286478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10060ba-7aeb-4e51-999c-82314086a72f None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:33.291507 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:33.292169 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:33.292455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:33.292733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] PATH_INFO: `/v3/users/8f374e9fd25a43f6ad8f6839d025133d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:33.294018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f374e9fd25a43f6ad8f6839d025133d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:33.296929 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:33.567953 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f374e9fd25a43f6ad8f6839d025133d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:33.579570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f374e9fd25a43f6ad8f6839d025133d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:33.676269 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f374e9fd25a43f6ad8f6839d025133d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:33.677221 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f374e9fd25a43f6ad8f6839d025133d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:33.699201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f374e9fd25a43f6ad8f6839d025133d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:33.706401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1392/2812] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:33 2022] DELETE /identity/v3/users/8f374e9fd25a43f6ad8f6839d025133d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:33.711014 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:33.711520 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:33.711620 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:33.731243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:33.732521 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:33.766626 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:33.799082 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1421/2813] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:33.809374 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:33.810889 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:33.839445 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:33.876029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0376-23e2-4e68-b350-1c2638dd008c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:33.880404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:33.881097 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:33.881378 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:33.881706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:33.891985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:33.894294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:33.905134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1393/2814] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:33.982460 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:33.984106 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:33.998864 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b887b56-28f2-4fe1-b1ba-06ad6a1f9a15 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:34.002896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:34.003652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:34.003940 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:34.004218 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] PATH_INFO: `/v3/users/7469f00c68a14ee082fdfd79374965a4` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:34.005475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7469f00c68a14ee082fdfd79374965a4)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:34.007636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:34.252983 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7469f00c68a14ee082fdfd79374965a4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.254114 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7469f00c68a14ee082fdfd79374965a4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.254996 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7469f00c68a14ee082fdfd79374965a4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.266867 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7469f00c68a14ee082fdfd79374965a4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.281126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-172a89ea-d5ee-40ae-b7d4-f12f301da0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7469f00c68a14ee082fdfd79374965a4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.434585 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:34.442772 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:34.443115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1422/2815] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:33 2022] DELETE /identity/v3/users/7469f00c68a14ee082fdfd79374965a4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:34.445321 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:34.445894 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:34.446180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:34.459301 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6d242-e142-4885-9811-976a744a41ab service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:34.469243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:34.470553 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:34.528600 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:34.529317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:34.529627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:34.529909 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] PATH_INFO: `/v3/projects/c2ac44136a2b459a8efe31f0bd42deea` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:34.531250 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ac44136a2b459a8efe31f0bd42deea)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:34.533317 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:34.541661 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1423/2816] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:34.552480 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:34.553936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:34.614618 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:34.619231 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ef203-dcda-432d-980b-8228e8714c5b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:34.623197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:34.623849 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:34.624140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:34.624509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:34.636475 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:34.638013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:34.650713 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1424/2817] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:34.735230 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ac44136a2b459a8efe31f0bd42deea', 'request_id': 'req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.741533 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ac44136a2b459a8efe31f0bd42deea', 'request_id': 'req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.870992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ac44136a2b459a8efe31f0bd42deea', 'request_id': 'req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.884962 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] The token cache is being invalidate because project c2ac44136a2b459a8efe31f0bd42deea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:34.885195 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.885935 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:34.887738 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1394/2818] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:34 2022] DELETE /identity/v3/projects/c2ac44136a2b459a8efe31f0bd42deea => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:34.894346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:34.894346 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:34.907292 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17250aaf-c6f0-47bd-abbd-db3c63a0f133 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:34.967944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:34.968609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:34.968896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:34.969170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] PATH_INFO: `/v3/users/fcb82e604211400faa12fc72239a954d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:34.970702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb82e604211400faa12fc72239a954d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:34.973366 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:35.154812 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb82e604211400faa12fc72239a954d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.155591 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb82e604211400faa12fc72239a954d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.156230 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb82e604211400faa12fc72239a954d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.165540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb82e604211400faa12fc72239a954d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.178966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb82e604211400faa12fc72239a954d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.330652 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:35.333852 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:35.339375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1425/2819] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:34 2022] DELETE /identity/v3/users/fcb82e604211400faa12fc72239a954d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:35.349369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e413e38-5b21-4b8c-ac57-a96fca0b16fc admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:35.421861 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:35.430759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:35.431499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:35.431786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:35.432067 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] PATH_INFO: `/v3/projects/3b64202a0bf34c298aed1656af5d31a7` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:35.433453 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b64202a0bf34c298aed1656af5d31a7)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:35.438900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:35.630294 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b64202a0bf34c298aed1656af5d31a7', 'request_id': 'req-7c45eb70-7674-40b3-a392-9773f76934e4'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.637380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b64202a0bf34c298aed1656af5d31a7', 'request_id': 'req-7c45eb70-7674-40b3-a392-9773f76934e4'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.864923 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b64202a0bf34c298aed1656af5d31a7', 'request_id': 'req-7c45eb70-7674-40b3-a392-9773f76934e4'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.879068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] The token cache is being invalidate because project 3b64202a0bf34c298aed1656af5d31a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:35.879362 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.880323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-7c45eb70-7674-40b3-a392-9773f76934e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:35.882031 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1395/2820] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:35 2022] DELETE /identity/v3/projects/3b64202a0bf34c298aed1656af5d31a7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:35.902639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:35.904987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:35.946737 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5195e6-41a7-4255-85bc-8227fa197500 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:36.029733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:36.031037 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:36.031644 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:36.032247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] PATH_INFO: `/v3/projects/8b31254e3d1c46d2a51ddc946f1f2a7c` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:36.034641 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b31254e3d1c46d2a51ddc946f1f2a7c)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:36.037351 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:36.052084 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:36.167614 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b31254e3d1c46d2a51ddc946f1f2a7c', 'request_id': 'req-123c742b-bfeb-42fb-b668-c2a281b11ad4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:36.177654 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b31254e3d1c46d2a51ddc946f1f2a7c', 'request_id': 'req-123c742b-bfeb-42fb-b668-c2a281b11ad4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:36.245247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b31254e3d1c46d2a51ddc946f1f2a7c', 'request_id': 'req-123c742b-bfeb-42fb-b668-c2a281b11ad4'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:36.261402 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] The token cache is being invalidate because project 8b31254e3d1c46d2a51ddc946f1f2a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:36.262151 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:36.263204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-123c742b-bfeb-42fb-b668-c2a281b11ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:36.265740 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1426/2821] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:35 2022] DELETE /identity/v3/projects/8b31254e3d1c46d2a51ddc946f1f2a7c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:36.272676 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c0b00-b2f0-4acf-8a82-98ce3dc139e8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:36.272975 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c0b00-b2f0-4acf-8a82-98ce3dc139e8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:36.273259 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c0b00-b2f0-4acf-8a82-98ce3dc139e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:36.302855 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-279c0b00-b2f0-4acf-8a82-98ce3dc139e8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:36.304258 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-279c0b00-b2f0-4acf-8a82-98ce3dc139e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:36.385605 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1396/2822] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:36.391810 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70764-b24e-4d35-841c-138ac3746ba8 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:36.392102 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70764-b24e-4d35-841c-138ac3746ba8 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:36.392400 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70764-b24e-4d35-841c-138ac3746ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:36.415140 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-5ee70764-b24e-4d35-841c-138ac3746ba8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:36.416425 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-5ee70764-b24e-4d35-841c-138ac3746ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:36.425934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1427/2823] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:36.430722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c0b00-b2f0-4acf-8a82-98ce3dc139e8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:36.445134 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c0b00-b2f0-4acf-8a82-98ce3dc139e8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:36.454589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:36.454589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:36.454589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:36.454589 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:36.455076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:36.455076 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:36.455919 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:36.470752 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1397/2824] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:06:36.475576 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70764-b24e-4d35-841c-138ac3746ba8 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:36.485728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70764-b24e-4d35-841c-138ac3746ba8 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:36.494213 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:36.494798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:36.495115 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:36.495403 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:36.496175 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:36.498253 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:36.832154 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1428/2825] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:36 2022] POST /identity/v3/projects => generated 367 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:36.836576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:36.847400 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731548b-0b02-4df0-a15e-4c690e19d32d admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:36.912138 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:36.913060 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:36.913229 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:36.913389 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:36.914914 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:36.916139 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:37.040312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1398/2826] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:36 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:37.041714 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:37.053394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f7f8-d6cd-45a2-941f-7ec1bdf43b3b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:37.058497 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:37.058916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:37.059212 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:37.059492 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:37.060315 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:37.062000 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:37.076033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1429/2827] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:37.081116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:37.092101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dede0-5ff2-48ad-bddf-19a8703449a2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:37.098151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168a04-c6af-4504-b73b-9087c65ecdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:37.098805 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168a04-c6af-4504-b73b-9087c65ecdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:37.099088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168a04-c6af-4504-b73b-9087c65ecdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:37.099369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168a04-c6af-4504-b73b-9087c65ecdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:37.100078 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b168a04-c6af-4504-b73b-9087c65ecdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:37.101747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b168a04-c6af-4504-b73b-9087c65ecdc1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:37.113677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1399/2828] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:06:37.118245 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:37.133385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988d4d0-1cf3-4dba-9096-b48fb018cf9a admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:37.134286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:37.134987 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:37.135279 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:37.135560 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] PATH_INFO: `/v3/projects/3cc469943d5b493b83d0f0c10ed89faa/users/e74d9822651f4af9b6f418c4a936c415/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:37.153587 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc469943d5b493b83d0f0c10ed89faa, user_id=e74d9822651f4af9b6f418c4a936c415, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:37.156538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:37.239822 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:37.256204 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1430/2829] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:37 2022] PUT /identity/v3/projects/3cc469943d5b493b83d0f0c10ed89faa/users/e74d9822651f4af9b6f418c4a936c415/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:37.267119 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:37.267411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:37.267692 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:37.303789 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] MFA Rules not processed for user `e74d9822651f4af9b6f418c4a936c415`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:37.305277 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:37.385065 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1400/2830] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:37.398299 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:37.400174 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:37.479182 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4a285-77df-495c-8d77-272a681821f1 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:37.484733 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5048d76e4ffb4e12bb76ad3c8e5095ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:37.487458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:37.487458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:37.487458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:37.497375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:37.499046 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:37.509709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1431/2831] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:38.255602 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:38.257129 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:38.330942 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976e0c1-5cc2-4dd7-87f8-cfb0632aa675 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:38.335468 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:38.336116 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:38.336414 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:38.336696 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] PATH_INFO: `/v3/users/d201a3416a774120985f41165f6fe84d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:38.337928 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d201a3416a774120985f41165f6fe84d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:38.339888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:38.576912 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd201a3416a774120985f41165f6fe84d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:38.585927 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd201a3416a774120985f41165f6fe84d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:38.684324 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd201a3416a774120985f41165f6fe84d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:38.685014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd201a3416a774120985f41165f6fe84d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:38.698608 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd201a3416a774120985f41165f6fe84d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:38.703152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:38.706319 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1401/2832] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:38 2022] DELETE /identity/v3/users/d201a3416a774120985f41165f6fe84d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:06:38.956637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:38.968846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03751d6e-7881-4808-83eb-1a6dc3f77736 service glance] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:39.022515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:39.043287 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:39.043960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:39.044295 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:39.044692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] PATH_INFO: `/v3/projects/0c7341b059f2431e8d37df49e7b7476f` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:39.046183 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7341b059f2431e8d37df49e7b7476f)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:39.048450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:39.159382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7341b059f2431e8d37df49e7b7476f', 'request_id': 'req-660d09bc-3f48-40d6-9556-3710541d565d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.165917 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7341b059f2431e8d37df49e7b7476f', 'request_id': 'req-660d09bc-3f48-40d6-9556-3710541d565d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.232843 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7341b059f2431e8d37df49e7b7476f', 'request_id': 'req-660d09bc-3f48-40d6-9556-3710541d565d'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.246761 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] The token cache is being invalidate because project 0c7341b059f2431e8d37df49e7b7476f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:39.247062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.247755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.249355 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1432/2833] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:38 2022] DELETE /identity/v3/projects/0c7341b059f2431e8d37df49e7b7476f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:39.254071 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:39.259044 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:39.270894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aa73e-239c-4f4b-9762-9d1cc8020413 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:39.339786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:39.340462 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:39.340753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:39.341042 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] PATH_INFO: `/v3/users/52aa13a011e34a0b9609091a4fb0009e` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:39.342381 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52aa13a011e34a0b9609091a4fb0009e)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:39.344326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:39.597395 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52aa13a011e34a0b9609091a4fb0009e'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.604716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52aa13a011e34a0b9609091a4fb0009e'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.712607 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52aa13a011e34a0b9609091a4fb0009e'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.713268 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52aa13a011e34a0b9609091a4fb0009e'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.727794 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-6c1e13ce-e149-4459-a887-8de7b8970707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52aa13a011e34a0b9609091a4fb0009e'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:39.734276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1402/2834] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:06:39 2022] DELETE /identity/v3/users/52aa13a011e34a0b9609091a4fb0009e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:40.032157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:40.034703 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:40.049930 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d09bc-3f48-40d6-9556-3710541d565d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:40.121980 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:40.122638 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.122927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.123205 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] PATH_INFO: `/v3/projects/41510aef69c94dc086f1b530595760cb` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.124382 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41510aef69c94dc086f1b530595760cb)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:40.126348 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:40.239450 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41510aef69c94dc086f1b530595760cb', 'request_id': 'req-de80503d-73f5-46a8-8f64-cf0abf290237'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:40.248226 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41510aef69c94dc086f1b530595760cb', 'request_id': 'req-de80503d-73f5-46a8-8f64-cf0abf290237'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:40.332970 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41510aef69c94dc086f1b530595760cb', 'request_id': 'req-de80503d-73f5-46a8-8f64-cf0abf290237'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:40.341062 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:40.344931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] The token cache is being invalidate because project 41510aef69c94dc086f1b530595760cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:06:40.348922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:40.348922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-de80503d-73f5-46a8-8f64-cf0abf290237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:06:40.348922 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1433/2835] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:06:40 2022] DELETE /identity/v3/projects/41510aef69c94dc086f1b530595760cb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:40.353556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc2f67-beb1-45fa-a9cc-75a85c438c68 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.354150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc2f67-beb1-45fa-a9cc-75a85c438c68 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.354150 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc2f67-beb1-45fa-a9cc-75a85c438c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.383173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-19bc2f67-beb1-45fa-a9cc-75a85c438c68 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:40.384393 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-19bc2f67-beb1-45fa-a9cc-75a85c438c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:40.456404 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1403/2836] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:40.464558 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d91a-ef4c-4834-b150-01758e52fc04 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.464936 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d91a-ef4c-4834-b150-01758e52fc04 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.465162 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d91a-ef4c-4834-b150-01758e52fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.486034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-eab6d91a-ef4c-4834-b150-01758e52fc04 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:40.487255 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-eab6d91a-ef4c-4834-b150-01758e52fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:40.496809 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1434/2837] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:40.501220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc2f67-beb1-45fa-a9cc-75a85c438c68 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:40.512020 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc2f67-beb1-45fa-a9cc-75a85c438c68 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:40.518894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:40.518894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.518894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.518894 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] PATH_INFO: `/v3/domains` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.519540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:06:40.519796 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:40.521416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:40.534386 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1404/2838] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:06:40.538800 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d91a-ef4c-4834-b150-01758e52fc04 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:40.548935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d91a-ef4c-4834-b150-01758e52fc04 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:40.553886 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:40.554510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.554785 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.555057 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.555728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:40.557861 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:40.667802 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1435/2839] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:06:40 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:40.672011 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:40.683871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ed12-4ccd-47bb-afcf-76d43f0ed54c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:40.688417 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:40.750222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:40.754879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.754879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.754879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] PATH_INFO: `/v3/users` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.754879 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:40.755451 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:40.862972 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1405/2840] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:06:40 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:06:40.867207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:40.878469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388881e-51a9-4c8d-a640-3a152e516b3e admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:40.883510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:40.884293 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.884656 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.884960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.885824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:40.887479 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:40.898814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1436/2841] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:40.905023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:40.916511 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c8cfa-7b30-4ae4-b8eb-77445afc62e8 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:40.921318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763742b6-10f9-45b4-863f-e103fff6c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:40.922085 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763742b6-10f9-45b4-863f-e103fff6c714 admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.922368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763742b6-10f9-45b4-863f-e103fff6c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.922650 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763742b6-10f9-45b4-863f-e103fff6c714 admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.923351 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763742b6-10f9-45b4-863f-e103fff6c714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:40.925588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763742b6-10f9-45b4-863f-e103fff6c714 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:40.937990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1406/2842] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:06:40.943185 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:40.953813 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477773-a8e9-4bb7-930c-ce3fb510f5dd admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:40.958700 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:40.959384 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:40.961405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:40.961405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] PATH_INFO: `/v3/projects/b847c283e4df40c185d786e71f276130/users/987ebbf310e84037a2199c172a0ff60d/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:40.976458 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b847c283e4df40c185d786e71f276130, user_id=987ebbf310e84037a2199c172a0ff60d, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:40.979237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:41.056647 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1437/2843] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:06:40 2022] PUT /identity/v3/projects/b847c283e4df40c185d786e71f276130/users/987ebbf310e84037a2199c172a0ff60d/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:06:41.069670 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279400-9bb6-49e5-9e9b-d13469e206f8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:41.070194 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279400-9bb6-49e5-9e9b-d13469e206f8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:41.070477 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279400-9bb6-49e5-9e9b-d13469e206f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:41.100689 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-3b279400-9bb6-49e5-9e9b-d13469e206f8 None None] MFA Rules not processed for user `987ebbf310e84037a2199c172a0ff60d`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:41.101992 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3b279400-9bb6-49e5-9e9b-d13469e206f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:41.175800 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1407/2844] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:41.186991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:41.188977 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:41.251236 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e5850-80b4-42db-bebb-5baaf6931349 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:41.255296 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:41.255932 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:41.256219 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:41.256498 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:41.271142 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:41.272674 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:41.282394 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1438/2845] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:06:43.151760 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656065e3-a157-4d78-873f-3ec3f30cb327 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:43.152312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656065e3-a157-4d78-873f-3ec3f30cb327 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:43.152312 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656065e3-a157-4d78-873f-3ec3f30cb327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:43.173133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-656065e3-a157-4d78-873f-3ec3f30cb327 None None] MFA Rules not processed for user `987ebbf310e84037a2199c172a0ff60d`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:06:43.174517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-656065e3-a157-4d78-873f-3ec3f30cb327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:43.182092 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1408/2846] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:06:45.367373 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:06:45.368796 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:45.469430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3ef3a-38f3-419a-aea8-784d456dde24 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:06:45.475202 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:06:45.476269 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:06:45.476557 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:06:45.476834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:06:45.479760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:06:45.495994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:06:45.495994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:06:45.510811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1439/2847] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:06:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:06:53.167255 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:55.504123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:01.000501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aef72-7619-41b8-a91d-e9279ada3edb None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:01.000957 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aef72-7619-41b8-a91d-e9279ada3edb None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:01.001068 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aef72-7619-41b8-a91d-e9279ada3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:01.021010 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f96aef72-7619-41b8-a91d-e9279ada3edb None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:01.022257 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f96aef72-7619-41b8-a91d-e9279ada3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:01.089251 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1409/2848] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:01.254198 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:01.255606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:01.325958 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a9397-048f-41b2-8465-b65d3f74591a service placement] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:01.331677 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:01.332302 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:01.332590 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:01.332872 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:01.341704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:01.343327 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:01.351692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1440/2849] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:07:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:07:02.175222 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:02.181009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:02.181009 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:02.196465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:02.197737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:02.206161 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1410/2850] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 1 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:02.219197 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:02.231158 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ab63-ec9c-4b62-a1ca-07c81c87a284 service swift] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:02.238343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a794e0-3ff1-4cad-bf63-072157c14bcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:02.238343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a794e0-3ff1-4cad-bf63-072157c14bcc service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:02.238343 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a794e0-3ff1-4cad-bf63-072157c14bcc service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:02.238728 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a794e0-3ff1-4cad-bf63-072157c14bcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:02.248879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a794e0-3ff1-4cad-bf63-072157c14bcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:02.250688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a794e0-3ff1-4cad-bf63-072157c14bcc service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:02.259912 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1441/2851] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:07:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:07:02.708974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:02.711944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:02.778985 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6ba55-6cab-4b2d-8724-b1b3d18d825e None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:02.784456 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:02.785173 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:02.785455 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:02.785778 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] PATH_INFO: `/v3/users/e74d9822651f4af9b6f418c4a936c415` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:02.786976 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74d9822651f4af9b6f418c4a936c415)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:02.788971 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:02.941582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93b792-fa59-4938-bea4-e18bd9930b4d None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:02.941806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93b792-fa59-4938-bea4-e18bd9930b4d None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:02.942083 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93b792-fa59-4938-bea4-e18bd9930b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:02.962341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2e93b792-fa59-4938-bea4-e18bd9930b4d None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:02.964608 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2e93b792-fa59-4938-bea4-e18bd9930b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:02.971507 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1442/2852] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 1 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:07:02.983537 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93b792-fa59-4938-bea4-e18bd9930b4d None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:02.996200 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93b792-fa59-4938-bea4-e18bd9930b4d None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:03.001764 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74d9822651f4af9b6f418c4a936c415'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:03.002018 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c3d59-c01f-4ba0-bd5e-a22b977be5cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:03.002664 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c3d59-c01f-4ba0-bd5e-a22b977be5cd service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:03.002941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c3d59-c01f-4ba0-bd5e-a22b977be5cd service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:03.003207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c3d59-c01f-4ba0-bd5e-a22b977be5cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:03.013212 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74d9822651f4af9b6f418c4a936c415'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:03.013489 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c3d59-c01f-4ba0-bd5e-a22b977be5cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:03.015105 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c3d59-c01f-4ba0-bd5e-a22b977be5cd service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:03.024755 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1443/2853] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:07:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:07:03.106369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74d9822651f4af9b6f418c4a936c415'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:03.106986 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74d9822651f4af9b6f418c4a936c415'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:03.120808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74d9822651f4af9b6f418c4a936c415'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:03.127241 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1411/2854] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:07:02 2022] DELETE /identity/v3/users/e74d9822651f4af9b6f418c4a936c415 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:03.132027 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c00b2-a970-4af3-8f1e-1d02be8d441f None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:03.132316 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c00b2-a970-4af3-8f1e-1d02be8d441f None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:03.132592 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c00b2-a970-4af3-8f1e-1d02be8d441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:03.154144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a43c00b2-a970-4af3-8f1e-1d02be8d441f None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:03.155387 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a43c00b2-a970-4af3-8f1e-1d02be8d441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:03.228680 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1444/2855] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:07:03.238619 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:03.240502 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:03.254695 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:03.305142 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24611c-d982-4e49-820c-1b7640b416c2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:03.309380 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:03.310080 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:03.310368 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:03.310722 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:03.322344 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:03.324844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:03.337177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1412/2856] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:07:03.754905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:03.755448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:03.755448 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:03.775921 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] MFA Rules not processed for user `192c96d090b948d38f6becdb8ce42c83`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:03.777186 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:03.815977 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:03.817598 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:03.847401 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f7c87-06d6-4b1d-bf00-c252a706aff6 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:03.851871 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1445/2857] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 1 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:03.853243 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:03.854177 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:03.854467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:03.854827 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] PATH_INFO: `/v3/projects/3cc469943d5b493b83d0f0c10ed89faa` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:03.856091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc469943d5b493b83d0f0c10ed89faa)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:03.858537 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:03.865615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:03.867052 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:03.872210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=100 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:03.942015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ad91-5909-4d71-8cb6-0498bb78211b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:03.947981 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517139-b86d-4594-943f-c09ea29269ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '159e2784eaf44126b4e04dacbb328add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:03.948636 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517139-b86d-4594-943f-c09ea29269ef service swift] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:03.948927 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517139-b86d-4594-943f-c09ea29269ef service swift] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:03.949211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517139-b86d-4594-943f-c09ea29269ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:03.958692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517139-b86d-4594-943f-c09ea29269ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:03.960337 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517139-b86d-4594-943f-c09ea29269ef service swift] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:03.969781 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1446/2858] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 1 16:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:07:03.975271 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc469943d5b493b83d0f0c10ed89faa', 'request_id': 'req-4316b12c-9eb5-462b-8965-e2728ed1e144'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:03.983082 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc469943d5b493b83d0f0c10ed89faa', 'request_id': 'req-4316b12c-9eb5-462b-8965-e2728ed1e144'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:04.072096 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc469943d5b493b83d0f0c10ed89faa', 'request_id': 'req-4316b12c-9eb5-462b-8965-e2728ed1e144'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:04.087110 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] The token cache is being invalidate because project 3cc469943d5b493b83d0f0c10ed89faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:07:04.087410 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:04.088293 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-4316b12c-9eb5-462b-8965-e2728ed1e144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:04.089905 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1413/2859] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:07:03 2022] DELETE /identity/v3/projects/3cc469943d5b493b83d0f0c10ed89faa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:04.095702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738199-c93e-4dca-abb9-e2d85794c242 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.095994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738199-c93e-4dca-abb9-e2d85794c242 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.096271 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738199-c93e-4dca-abb9-e2d85794c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.117633 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-e1738199-c93e-4dca-abb9-e2d85794c242 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:04.118875 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-e1738199-c93e-4dca-abb9-e2d85794c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:04.180709 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1447/2860] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:04.253005 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba6e5-566f-4e01-91ed-2cbafd3371b8 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.253644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba6e5-566f-4e01-91ed-2cbafd3371b8 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.253644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba6e5-566f-4e01-91ed-2cbafd3371b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.275045 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-7fdba6e5-566f-4e01-91ed-2cbafd3371b8 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:04.276283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-7fdba6e5-566f-4e01-91ed-2cbafd3371b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:04.285659 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1414/2861] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:04.290341 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1738199-c93e-4dca-abb9-e2d85794c242 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:04.303760 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1738199-c93e-4dca-abb9-e2d85794c242 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:04.307735 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:04.308430 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.308670 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.308964 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.310216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:07:04.310528 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:04.312928 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:04.326059 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1448/2862] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:07:04.330524 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba6e5-566f-4e01-91ed-2cbafd3371b8 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:04.340335 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba6e5-566f-4e01-91ed-2cbafd3371b8 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:04.346160 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:04.346808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.347088 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.347361 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.348028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:04.350040 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:04.483384 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1415/2863] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:07:04 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:07:04.493285 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:04.505150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908f695-73cf-465e-92ba-05581da43106 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:04.573300 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:04.574286 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.574464 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.574769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.575529 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:04.577602 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:04.713093 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1449/2864] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:07:04 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:07:04.717252 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:04.728532 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3adce1-7cc1-4070-bbff-ffd8a486b8a1 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:04.733168 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:04.733844 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.734132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.737716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.737716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:04.737716 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:04.747003 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1416/2865] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:07:04.751690 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:04.762772 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cf60e-9df0-4905-a22a-4291cceb8043 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:04.768013 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72cd7f-794a-45fb-b9aa-2d609ab1c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:04.772108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72cd7f-794a-45fb-b9aa-2d609ab1c1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.772108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72cd7f-794a-45fb-b9aa-2d609ab1c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.772108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72cd7f-794a-45fb-b9aa-2d609ab1c1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.772108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72cd7f-794a-45fb-b9aa-2d609ab1c1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:04.772108 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72cd7f-794a-45fb-b9aa-2d609ab1c1a1 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:04.774094 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:04.785859 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1450/2866] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:07:04.790193 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:04.800249 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c87d21-f07f-451c-bd76-4f88311f018e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:04.804817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:04.805498 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.805846 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.806123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] PATH_INFO: `/v3/projects/fc7501b9db6946c3975ffb6262dfaa22/users/7cda8b0967394b9e93e6a785af8de482/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.824627 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7501b9db6946c3975ffb6262dfaa22, user_id=7cda8b0967394b9e93e6a785af8de482, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:04.829189 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:04.919025 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1417/2867] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:07:04 2022] PUT /identity/v3/projects/fc7501b9db6946c3975ffb6262dfaa22/users/7cda8b0967394b9e93e6a785af8de482/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:07:04.930257 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a68e-edb4-41d9-99ba-ae2ece21c05b None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:04.930469 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a68e-edb4-41d9-99ba-ae2ece21c05b None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:04.930750 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a68e-edb4-41d9-99ba-ae2ece21c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:04.960104 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-2736a68e-edb4-41d9-99ba-ae2ece21c05b None None] MFA Rules not processed for user `7cda8b0967394b9e93e6a785af8de482`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:04.961319 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-2736a68e-edb4-41d9-99ba-ae2ece21c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:05.026773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1451/2868] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:05.038851 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:05.040678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:05.079029 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:05.101864 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c9e28-4fcb-429e-a828-17ea0341abf2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:05.105506 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7c2cb-46c4-42d6-82b2-257f0e3c0d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:05.106152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c2cb-46c4-42d6-82b2-257f0e3c0d30 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:05.106437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c2cb-46c4-42d6-82b2-257f0e3c0d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:05.106713 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c2cb-46c4-42d6-82b2-257f0e3c0d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:05.115270 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7c2cb-46c4-42d6-82b2-257f0e3c0d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:05.116715 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7c2cb-46c4-42d6-82b2-257f0e3c0d30 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:05.126077 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1418/2869] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:07:05.152452 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a68e-edb4-41d9-99ba-ae2ece21c05b None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:05.230999 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a68e-edb4-41d9-99ba-ae2ece21c05b None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:05.236510 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:05.239107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:05.239107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:05.239107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] PATH_INFO: `/v3/users/7cda8b0967394b9e93e6a785af8de482` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:05.239107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cda8b0967394b9e93e6a785af8de482)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:05.241375 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:05.460916 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cda8b0967394b9e93e6a785af8de482'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:05.461637 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cda8b0967394b9e93e6a785af8de482'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:05.462249 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cda8b0967394b9e93e6a785af8de482'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:05.470340 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cda8b0967394b9e93e6a785af8de482'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:05.483606 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cda8b0967394b9e93e6a785af8de482'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:05.576385 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1452/2870] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:07:05 2022] DELETE /identity/v3/users/7cda8b0967394b9e93e6a785af8de482 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:05.582808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:05.585874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:05.585874 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:05.608620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:05.608620 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:05.676102 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1419/2871] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:05.686207 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:05.687960 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:05.698668 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:05.756290 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec8dc-d30e-470e-9e57-b7218cf87972 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:05.760413 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caece671-6be9-434b-845d-69ff2498bcb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:05.761081 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caece671-6be9-434b-845d-69ff2498bcb5 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:05.761365 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caece671-6be9-434b-845d-69ff2498bcb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:05.761686 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caece671-6be9-434b-845d-69ff2498bcb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:05.784678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caece671-6be9-434b-845d-69ff2498bcb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:05.784678 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caece671-6be9-434b-845d-69ff2498bcb5 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:05.792312 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1453/2872] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:07:06.256463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:06.258059 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:06.272521 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235b782-c4d2-4945-b5ac-bccb0fec7d6d None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:06.278329 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:06.279424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.279424 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.279644 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] PATH_INFO: `/v3/projects/fc7501b9db6946c3975ffb6262dfaa22` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.280775 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7501b9db6946c3975ffb6262dfaa22)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:06.283564 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:06.394782 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7501b9db6946c3975ffb6262dfaa22', 'request_id': 'req-f9157f51-993f-4040-a239-d9e639a32793'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:06.400416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7501b9db6946c3975ffb6262dfaa22', 'request_id': 'req-f9157f51-993f-4040-a239-d9e639a32793'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:06.477823 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7501b9db6946c3975ffb6262dfaa22', 'request_id': 'req-f9157f51-993f-4040-a239-d9e639a32793'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:06.490436 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] The token cache is being invalidate because project fc7501b9db6946c3975ffb6262dfaa22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:07:06.490733 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:06.491396 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f9157f51-993f-4040-a239-d9e639a32793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:06.492944 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1420/2873] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:07:06 2022] DELETE /identity/v3/projects/fc7501b9db6946c3975ffb6262dfaa22 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:06.498034 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db44a-be01-4946-b192-0d5792734273 None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.498326 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db44a-be01-4946-b192-0d5792734273 None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.498607 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db44a-be01-4946-b192-0d5792734273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.521297 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-b26db44a-be01-4946-b192-0d5792734273 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:06.522564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-b26db44a-be01-4946-b192-0d5792734273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:06.584215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1454/2874] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:06.591974 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93811a-fecd-4ac0-ab78-67dd915aec17 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.592475 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93811a-fecd-4ac0-ab78-67dd915aec17 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.592576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93811a-fecd-4ac0-ab78-67dd915aec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.614337 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-1f93811a-fecd-4ac0-ab78-67dd915aec17 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:06.615840 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-1f93811a-fecd-4ac0-ab78-67dd915aec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:06.624170 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1421/2875] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:06.629482 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db44a-be01-4946-b192-0d5792734273 None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:06.639517 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db44a-be01-4946-b192-0d5792734273 None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:06.644852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:06.645473 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.645791 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.646107 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.646803 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:07:06.647123 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:06.648721 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:06.661615 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1455/2876] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:07:06.666204 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93811a-fecd-4ac0-ab78-67dd915aec17 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:06.675790 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93811a-fecd-4ac0-ab78-67dd915aec17 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:06.680496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:06.681152 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.681500 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.681817 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.682516 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:06.684431 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:06.779062 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1422/2877] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:07:06 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:07:06.783170 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:06.794032 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8b542-c024-43f9-95b7-ec741a6a5560 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:06.810934 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:06.812948 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:06.856226 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:06.858199 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:06.858959 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.859247 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.859527 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.860210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:06.862925 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:06.891275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb42ae-d0b5-4d8d-bf66-51c761c4fae2 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:06.896179 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:06.896836 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.897124 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.897408 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] PATH_INFO: `/v3/users/987ebbf310e84037a2199c172a0ff60d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.898677 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987ebbf310e84037a2199c172a0ff60d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:06.900831 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:06.955896 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1456/2878] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:07:06 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:07:06.961196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:06.972215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43172129-28fc-4782-b840-2a1b0c974d60 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:06.976994 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:06.977609 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:06.977899 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:06.978203 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:06.978979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:06.980583 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:06.992263 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1457/2879] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:07:06.996575 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:07.007085 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645985fa-bd12-42cb-86ff-83327f4aa11d admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:07.011876 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:07.012483 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:07.012769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:07.013044 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:07.013811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:07.015399 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:07.025389 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1458/2880] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:07:07.029773 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:07.035897 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:07.039625 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ddcee-4400-4887-93b0-06f33e928a90 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:07.044258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013d337-e3d1-4557-9a65-4232c219b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:07.044905 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013d337-e3d1-4557-9a65-4232c219b38f admin admin] REQUEST_METHOD: `PUT` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:07.045211 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013d337-e3d1-4557-9a65-4232c219b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:07.045485 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013d337-e3d1-4557-9a65-4232c219b38f admin admin] PATH_INFO: `/v3/projects/6a9b8e93438e4d77bf2a7a577307bfd7/users/b119a556191c4989878dbb2069856b59/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:07.060173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013d337-e3d1-4557-9a65-4232c219b38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9b8e93438e4d77bf2a7a577307bfd7, user_id=b119a556191c4989878dbb2069856b59, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:07.063215 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013d337-e3d1-4557-9a65-4232c219b38f admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:07.143363 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987ebbf310e84037a2199c172a0ff60d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.150406 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987ebbf310e84037a2199c172a0ff60d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.164363 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1459/2881] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:07:07 2022] PUT /identity/v3/projects/6a9b8e93438e4d77bf2a7a577307bfd7/users/b119a556191c4989878dbb2069856b59/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:07:07.176701 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:07.176991 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:07.177270 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:07.209798 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] MFA Rules not processed for user `b119a556191c4989878dbb2069856b59`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:07.211019 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:07.238052 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987ebbf310e84037a2199c172a0ff60d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.238854 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987ebbf310e84037a2199c172a0ff60d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.252687 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-f44e2a35-456f-4852-82cc-956c16793446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987ebbf310e84037a2199c172a0ff60d'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.261990 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1423/2882] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:07:06 2022] DELETE /identity/v3/users/987ebbf310e84037a2199c172a0ff60d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:07:07.269242 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:07.269582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:07.269871 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:07.297509 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1460/2883] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:07:07.300465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:07.300465 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:07.300829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:07.300829 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:07.368811 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3bf5-0bf3-47e0-92eb-aaa2c6a1576a None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:07.377007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1424/2884] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:07.387495 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:07.388910 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:07.421564 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:07.422196 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:07.422491 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:07.422770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:07.451325 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92593d-6ac2-4e5c-8ddc-6ef9fb0f74c2 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:07.457285 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:07.458013 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:07.458296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:07.458570 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:07.464808 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:07.469411 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:07.471626 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:07.482283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1425/2885] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:07:07.490582 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:07.492039 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:07.502806 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1461/2886] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:07:07.571704 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:07.725888 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:07.727355 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:07.743353 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082bab9-ac22-44e4-b888-1e691d493b56 service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:07.748720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:07.748720 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:07.749023 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:07.749318 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] PATH_INFO: `/v3/projects/b847c283e4df40c185d786e71f276130` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:07.750706 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b847c283e4df40c185d786e71f276130)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:07.752647 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:07.861100 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b847c283e4df40c185d786e71f276130', 'request_id': 'req-cd310f6d-4b82-4b04-a493-6970911869eb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.867018 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b847c283e4df40c185d786e71f276130', 'request_id': 'req-cd310f6d-4b82-4b04-a493-6970911869eb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.946517 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b847c283e4df40c185d786e71f276130', 'request_id': 'req-cd310f6d-4b82-4b04-a493-6970911869eb'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.959151 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] The token cache is being invalidate because project b847c283e4df40c185d786e71f276130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:07:07.959440 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.960104 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-cd310f6d-4b82-4b04-a493-6970911869eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:07.961793 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1426/2887] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:07:07 2022] DELETE /identity/v3/projects/b847c283e4df40c185d786e71f276130 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:17.737834 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=9 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:17.956030 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:19.283799 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:19.285434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:19.305150 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b463e-e18c-41b0-9ac4-2d4ad1ce12a2 service cinder] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:19.367431 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:19.368126 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:19.368412 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:19.368692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] PATH_INFO: `/v3/users/b119a556191c4989878dbb2069856b59` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:19.369953 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b119a556191c4989878dbb2069856b59)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:19.371924 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:19.558335 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b119a556191c4989878dbb2069856b59'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:19.558943 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b119a556191c4989878dbb2069856b59'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:19.559598 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b119a556191c4989878dbb2069856b59'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:19.566873 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b119a556191c4989878dbb2069856b59'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:19.578643 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b119a556191c4989878dbb2069856b59'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:19.686260 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1462/2888] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:07:19 2022] DELETE /identity/v3/users/b119a556191c4989878dbb2069856b59 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:19.691086 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:19.691576 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:19.691693 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:19.711007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:19.712202 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:19.771372 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1427/2889] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:19.781134 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:19.783252 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:19.842294 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9023e-ef1b-412e-ad0b-7bca66f288d0 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:19.845824 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f43a1-0e65-4056-a0f5-e643c8cca3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:19.846443 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f43a1-0e65-4056-a0f5-e643c8cca3dc service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:19.846729 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f43a1-0e65-4056-a0f5-e643c8cca3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:19.847007 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f43a1-0e65-4056-a0f5-e643c8cca3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:19.855907 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f43a1-0e65-4056-a0f5-e643c8cca3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:19.857508 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f43a1-0e65-4056-a0f5-e643c8cca3dc service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:19.866904 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1463/2890] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:07:20.537657 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:20.539276 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:20.562407 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bd824-83d2-41ed-a136-bdd7ba6a0760 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:20.571685 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:20.572369 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:20.572729 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:20.572969 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] PATH_INFO: `/v3/projects/6a9b8e93438e4d77bf2a7a577307bfd7` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:20.574220 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9b8e93438e4d77bf2a7a577307bfd7)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:20.576155 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:20.674890 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9b8e93438e4d77bf2a7a577307bfd7', 'request_id': 'req-01e3057f-8313-44bc-b477-bf51022455af'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:20.680943 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9b8e93438e4d77bf2a7a577307bfd7', 'request_id': 'req-01e3057f-8313-44bc-b477-bf51022455af'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:20.774467 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9b8e93438e4d77bf2a7a577307bfd7', 'request_id': 'req-01e3057f-8313-44bc-b477-bf51022455af'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:20.787710 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] The token cache is being invalidate because project 6a9b8e93438e4d77bf2a7a577307bfd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:07:20.788007 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:20.788654 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-01e3057f-8313-44bc-b477-bf51022455af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:20.790238 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1428/2891] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:07:20 2022] DELETE /identity/v3/projects/6a9b8e93438e4d77bf2a7a577307bfd7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:20.795445 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60890-5055-43d9-8abb-b4bfaa73128c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:20.796132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60890-5055-43d9-8abb-b4bfaa73128c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:20.796132 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60890-5055-43d9-8abb-b4bfaa73128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:20.823900 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-6aa60890-5055-43d9-8abb-b4bfaa73128c None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:20.825129 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6aa60890-5055-43d9-8abb-b4bfaa73128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:20.843398 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:20.886645 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1464/2892] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:20.895014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6f795-8de2-49e1-b839-3367bdc27440 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:20.895225 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6f795-8de2-49e1-b839-3367bdc27440 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:20.895566 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6f795-8de2-49e1-b839-3367bdc27440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:20.916932 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-d0d6f795-8de2-49e1-b839-3367bdc27440 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:20.918201 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-d0d6f795-8de2-49e1-b839-3367bdc27440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:20.927275 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1429/2893] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:20.931784 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa60890-5055-43d9-8abb-b4bfaa73128c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:20.942814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa60890-5055-43d9-8abb-b4bfaa73128c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:20.947540 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:20.948163 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:20.948451 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:20.948731 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] PATH_INFO: `/v3/domains` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:20.949434 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:07:20.949783 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:20.951421 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:20.964033 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1465/2894] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 1 16:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:07:20.968742 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6f795-8de2-49e1-b839-3367bdc27440 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:20.978924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6f795-8de2-49e1-b839-3367bdc27440 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:20.983663 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:20.984281 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:20.984563 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:20.984839 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] PATH_INFO: `/v3/projects` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:20.985499 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:20.987429 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:21.073614 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1430/2895] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 1 16:07:20 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:07:21.078101 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:21.088895 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fc324-d643-486d-b3be-2cf5f2044329 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:21.147770 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:21.148405 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:21.148692 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:21.148979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] PATH_INFO: `/v3/users` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:21.149688 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:21.151639 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:21.232456 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1466/2896] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 1 16:07:21 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:07:21.236900 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:21.247984 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3225c8d-78bc-4cc4-be43-de427a175347 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:21.253145 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:21.253821 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:21.254133 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:21.254416 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] PATH_INFO: `/v3/roles` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:21.255123 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:21.256753 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:21.270820 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1431/2897] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:07:21.274118 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:21.285652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a69aa-f48f-4fe0-9f47-39aac58f6188 admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:21.290545 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79060bb-3618-47d8-a9d3-c917a8896877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:21.291259 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79060bb-3618-47d8-a9d3-c917a8896877 admin admin] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:21.291544 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79060bb-3618-47d8-a9d3-c917a8896877 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:21.291828 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79060bb-3618-47d8-a9d3-c917a8896877 admin admin] PATH_INFO: `/v3/roles` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:21.292538 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79060bb-3618-47d8-a9d3-c917a8896877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:21.294210 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79060bb-3618-47d8-a9d3-c917a8896877 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:21.306006 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1467/2898] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 1 16:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:07:21.310423 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:21.322091 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64241ab-7a71-4795-bd81-4d79716069fd admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:21.326803 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:21.327478 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] REQUEST_METHOD: `PUT` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:21.327761 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:21.328038 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] PATH_INFO: `/v3/projects/05b8d796c68c4325b121f798185aaedc/users/194b5c25c1f4461cadc425cc5f4437b0/roles/da9b6fc593c747e48d031adf8b20978d` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:21.344930 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b8d796c68c4325b121f798185aaedc, user_id=194b5c25c1f4461cadc425cc5f4437b0, role_id=da9b6fc593c747e48d031adf8b20978d)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:21.347807 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:21.425980 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1432/2899] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 1 16:07:21 2022] PUT /identity/v3/projects/05b8d796c68c4325b121f798185aaedc/users/194b5c25c1f4461cadc425cc5f4437b0/roles/da9b6fc593c747e48d031adf8b20978d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:07:21.439941 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869c93-a73f-4c96-bf13-063945281a9c None None] REQUEST_METHOD: `POST` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:21.440240 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869c93-a73f-4c96-bf13-063945281a9c None None] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:21.440515 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869c93-a73f-4c96-bf13-063945281a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:21.474234 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.auth.core [None req-a2869c93-a73f-4c96-bf13-063945281a9c None None] MFA Rules not processed for user `194b5c25c1f4461cadc425cc5f4437b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:21.480015 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-a2869c93-a73f-4c96-bf13-063945281a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:21.549503 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1468/2900] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:21.560505 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:21.562334 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:21.586856 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:21.630815 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3cdad-dd95-4082-9406-48ceff8a7687 admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:21.635289 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1e33-efcd-4462-9b81-3746c0065385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bdef4163b5048ed9c9815683a44f019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:21.635917 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1e33-efcd-4462-9b81-3746c0065385 service cinder] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:21.636203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1e33-efcd-4462-9b81-3746c0065385 service cinder] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:21.636484 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1e33-efcd-4462-9b81-3746c0065385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:21.645747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f1e33-efcd-4462-9b81-3746c0065385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:21.647200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f1e33-efcd-4462-9b81-3746c0065385 service cinder] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:21.656366 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1433/2901] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:07:31.571794 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:31.717352 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=17 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:33.282324 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2869c93-a73f-4c96-bf13-063945281a9c None None] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:33.351216 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2869c93-a73f-4c96-bf13-063945281a9c None None] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:33.355979 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:33.356663 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:33.356952 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:33.357232 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] PATH_INFO: `/v3/users/194b5c25c1f4461cadc425cc5f4437b0` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:33.358468 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] RBAC: Authorizing `identity:delete_user(user_id=194b5c25c1f4461cadc425cc5f4437b0)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:33.361078 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:33.552267 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194b5c25c1f4461cadc425cc5f4437b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:33.552934 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194b5c25c1f4461cadc425cc5f4437b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:33.553717 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194b5c25c1f4461cadc425cc5f4437b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:33.561471 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194b5c25c1f4461cadc425cc5f4437b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:33.573993 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194b5c25c1f4461cadc425cc5f4437b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:33.664814 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1469/2902] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:07:33 2022] DELETE /identity/v3/users/194b5c25c1f4461cadc425cc5f4437b0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:33.669588 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] REQUEST_METHOD: `POST` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:33.670101 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:33.670203 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:33.690924 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.auth.core [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] MFA Rules not processed for user `c6476155f7c9405fac6f2d48d97cbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=92564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:07:33.692283 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:33.763847 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1434/2903] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 1 16:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:07:33.774329 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:33.775893 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:33.839516 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3523eb-fc3d-4c8a-9d1e-b13736ff767c admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:33.843157 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:33.843935 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:33.844756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:33.845042 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:33.854822 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:33.856291 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:33.866870 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1470/2904] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:07:34.310021 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:07:34.311516 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:07:34.324737 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234f5b-2240-4e7e-a87c-25f4feac9735 None None] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:07:34.330291 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:07:34.336208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:07:34.336208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:07:34.336208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] PATH_INFO: `/v3/projects/05b8d796c68c4325b121f798185aaedc` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:07:34.336208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b8d796c68c4325b121f798185aaedc)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:07:34.336208 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:07:34.502699 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b8d796c68c4325b121f798185aaedc', 'request_id': 'req-bfa19077-1d05-4906-9d72-555442a4725c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:34.508562 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b8d796c68c4325b121f798185aaedc', 'request_id': 'req-bfa19077-1d05-4906-9d72-555442a4725c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:34.603438 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b8d796c68c4325b121f798185aaedc', 'request_id': 'req-bfa19077-1d05-4906-9d72-555442a4725c'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:34.616501 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] The token cache is being invalidate because project 05b8d796c68c4325b121f798185aaedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:07:34.616786 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:34.617450 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:07:34.619017 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1435/2905] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:07:34 2022] DELETE /identity/v3/projects/05b8d796c68c4325b121f798185aaedc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:07:43.862268 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:44.613485 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:54.750939 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:08:54.752651 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:08:54.769180 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96751b9-0be3-43c2-a049-bf2610474d9f service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:08:54.837966 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:08:54.838595 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:08:54.838880 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:08:54.839303 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:08:54.841100 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:08:54.954144 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:08:54.956846 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:08:54.987248 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1471/2906] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:08:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:08:56.183421 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:08:56.185028 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:08:56.198580 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa19077-1d05-4906-9d72-555442a4725c admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:08:56.202326 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:08:56.202989 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:08:56.203296 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:08:56.203556 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:08:56.205359 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:08:56.219673 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:08:56.221140 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:08:56.236149 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1436/2907] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:09:04.983391 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=63 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:05.729054 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:09:05.739333 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb13cf-cb4a-468a-89e5-cdaef7d96a78 service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:09:05.749258 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90399c6cab2341f1af74d154c819bff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:09:05.750502 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] REQUEST_METHOD: `GET` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:09:05.750836 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:09:05.751045 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:09:05.752879 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:09:05.842280 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:09:05.843931 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:09:05.854946 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1472/2908] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:09:06.228049 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=6 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:06.550118 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:09:06.551584 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:09:06.567758 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75261642-f3c4-4ccb-8192-d1e0e54645cf service neutron] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:09:06.572323 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:09:06.574235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:09:06.574235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:09:06.574235 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] PATH_INFO: `/v3/users/8536a7207a6247f49008909b6f3ee858` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:09:06.574747 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8536a7207a6247f49008909b6f3ee858)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:09:06.576678 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:09:06.849153 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8536a7207a6247f49008909b6f3ee858'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:06.857437 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8536a7207a6247f49008909b6f3ee858'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:06.941463 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8536a7207a6247f49008909b6f3ee858'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:06.942141 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8536a7207a6247f49008909b6f3ee858'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:06.958982 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8536a7207a6247f49008909b6f3ee858'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:06.966164 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1437/2909] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:09:06 2022] DELETE /identity/v3/users/8536a7207a6247f49008909b6f3ee858 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:09:07.223193 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:09:07.233655 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63e7d1-4b3f-497b-9c9a-96ec51ab48bf service neutron] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:09:07.292648 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:09:07.293243 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:09:07.293554 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:09:07.293826 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] PATH_INFO: `/v3/projects/496aa09ed41243d7beb61b96cf2675ba` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:09:07.295237 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=496aa09ed41243d7beb61b96cf2675ba)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:09:07.297097 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:09:07.399769 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496aa09ed41243d7beb61b96cf2675ba', 'request_id': 'req-6c328907-6204-4055-8ccf-c6fa08a95a0b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.405973 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496aa09ed41243d7beb61b96cf2675ba', 'request_id': 'req-6c328907-6204-4055-8ccf-c6fa08a95a0b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.492173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496aa09ed41243d7beb61b96cf2675ba', 'request_id': 'req-6c328907-6204-4055-8ccf-c6fa08a95a0b'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.504173 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] The token cache is being invalidate because project 496aa09ed41243d7beb61b96cf2675ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:09:07.504429 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.505110 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.506652 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1473/2910] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:09:07 2022] DELETE /identity/v3/projects/496aa09ed41243d7beb61b96cf2675ba => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:09:07.510785 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:09:07.512263 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:09:07.525863 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b383d8-e912-48dc-80f2-53ea59dd384f admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:09:07.585019 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:09:07.585712 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:09:07.586014 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:09:07.586290 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] PATH_INFO: `/v3/users/38f5b76f04fe46788ce5a0b106a994e9` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:09:07.587496 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f5b76f04fe46788ce5a0b106a994e9)` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:09:07.589432 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:09:07.780582 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f5b76f04fe46788ce5a0b106a994e9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.788247 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f5b76f04fe46788ce5a0b106a994e9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.886132 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f5b76f04fe46788ce5a0b106a994e9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.886768 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f5b76f04fe46788ce5a0b106a994e9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.895759 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:07.900474 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.notifications [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f5b76f04fe46788ce5a0b106a994e9'} {{(pid=92564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:07.906641 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1438/2911] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 1 16:09:07 2022] DELETE /identity/v3/users/38f5b76f04fe46788ce5a0b106a994e9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:09:08.186500 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Authenticating user token {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:09:08.193992 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.fernet_utils [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:09:08.203597 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c328907-6204-4055-8ccf-c6fa08a95a0b admin admin] Validating token access rules against request {{(pid=92565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:09:08.232702 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:08.264742 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6476155f7c9405fac6f2d48d97cbd58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c484252c6e543fcb5b380854c3b730a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:09:08.265407 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:09:08.265756 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:09:08.266903 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] PATH_INFO: `/v3/projects/66c752ca630f4edc8f3e166f20d8bc41` {{(pid=92565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:09:08.268541 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c752ca630f4edc8f3e166f20d8bc41)` {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:09:08.270588 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] RBAC: Authorization granted {{(pid=92565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:09:08.402835 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c752ca630f4edc8f3e166f20d8bc41', 'request_id': 'req-990db5be-e6fe-45c9-a906-d491196028b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:08.409852 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c752ca630f4edc8f3e166f20d8bc41', 'request_id': 'req-990db5be-e6fe-45c9-a906-d491196028b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:08.469167 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c752ca630f4edc8f3e166f20d8bc41', 'request_id': 'req-990db5be-e6fe-45c9-a906-d491196028b0'} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:08.481990 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] The token cache is being invalidate because project 66c752ca630f4edc8f3e166f20d8bc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:09:08.482282 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:08.482944 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG keystone.notifications [None req-990db5be-e6fe-45c9-a906-d491196028b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:09:08.484465 dv-cinder-847132-3-smb devstack@keystone.service[92565]: [pid: 92565|app: 0|req: 1474/2912] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 1 16:09:08 2022] DELETE /identity/v3/projects/66c752ca630f4edc8f3e166f20d8bc41 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:09:18.193072 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:18.478792 dv-cinder-847132-3-smb devstack@keystone.service[92565]: DEBUG dbcounter [-] [92565] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:12:41.917658 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Authenticating user token {{(pid=92564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:12:41.919443 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:12:41.991181 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65840f97-28db-410c-bad0-f41573b11a2e admin admin] Validating token access rules against request {{(pid=92564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:12:42.050286 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82684cad-482f-4506-b6cc-69913b19f658 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d1d3e9e0b7042978e47d3912df36daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85b2a83e5a4a48d9a19f34be96478f74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:12:42.050913 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82684cad-482f-4506-b6cc-69913b19f658 service placement] REQUEST_METHOD: `GET` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:12:42.051200 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82684cad-482f-4506-b6cc-69913b19f658 service placement] SCRIPT_NAME: `/identity` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:12:42.051481 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82684cad-482f-4506-b6cc-69913b19f658 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:12:42.053305 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.fernet_utils [None req-82684cad-482f-4506-b6cc-69913b19f658 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:12:42.064926 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82684cad-482f-4506-b6cc-69913b19f658 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:12:42.066540 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82684cad-482f-4506-b6cc-69913b19f658 service placement] RBAC: Authorization granted {{(pid=92564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:12:42.076459 dv-cinder-847132-3-smb devstack@keystone.service[92564]: [pid: 92564|app: 0|req: 1439/2913] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 1 16:12:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:12:52.072207 dv-cinder-847132-3-smb devstack@keystone.service[92564]: DEBUG dbcounter [-] [92564] Writing DB stats keystone:SELECT=58 {{(pid=92564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}